Package org.apache.cassandra.hadoop.cql3
Class CqlRecordReader
- java.lang.Object
-
- org.apache.hadoop.mapreduce.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
-
- org.apache.cassandra.hadoop.cql3.CqlRecordReader
-
- All Implemented Interfaces:
java.io.Closeable
,java.lang.AutoCloseable
,org.apache.hadoop.mapred.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
public class CqlRecordReader extends org.apache.hadoop.mapreduce.RecordReader<java.lang.Long,com.datastax.driver.core.Row> implements org.apache.hadoop.mapred.RecordReader<java.lang.Long,com.datastax.driver.core.Row>, java.lang.AutoCloseable
CqlRecordReader reads the rows return from the CQL query It uses CQL auto-paging.
Return a Long as a local CQL row key starts from 0;
Row as C* java driver CQL result set row 1) select clause must include partition key columns (to calculate the progress based on the actual CF row processed) 2) where clause must include token(partition_key1, ... , partition_keyn) > ? and token(partition_key1, ... , partition_keyn) <= ? (in the right order)
-
-
Field Summary
Fields Modifier and Type Field Description protected int
nativeProtocolVersion
-
Constructor Summary
Constructors Constructor Description CqlRecordReader()
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description void
close()
java.lang.Long
createKey()
com.datastax.driver.core.Row
createValue()
java.lang.Long
getCurrentKey()
com.datastax.driver.core.Row
getCurrentValue()
int
getNativeProtocolVersion()
Return native version protocol of the cluster connectionlong
getPos()
float
getProgress()
void
initialize(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context)
boolean
next(java.lang.Long key, com.datastax.driver.core.Row value)
boolean
nextKeyValue()
-
-
-
Method Detail
-
initialize
public void initialize(org.apache.hadoop.mapreduce.InputSplit split, org.apache.hadoop.mapreduce.TaskAttemptContext context) throws java.io.IOException
- Specified by:
initialize
in classorg.apache.hadoop.mapreduce.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
- Throws:
java.io.IOException
-
close
public void close()
- Specified by:
close
in interfacejava.lang.AutoCloseable
- Specified by:
close
in interfacejava.io.Closeable
- Specified by:
close
in interfaceorg.apache.hadoop.mapred.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
- Specified by:
close
in classorg.apache.hadoop.mapreduce.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
-
getCurrentKey
public java.lang.Long getCurrentKey()
- Specified by:
getCurrentKey
in classorg.apache.hadoop.mapreduce.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
-
getCurrentValue
public com.datastax.driver.core.Row getCurrentValue()
- Specified by:
getCurrentValue
in classorg.apache.hadoop.mapreduce.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
-
getProgress
public float getProgress()
- Specified by:
getProgress
in interfaceorg.apache.hadoop.mapred.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
- Specified by:
getProgress
in classorg.apache.hadoop.mapreduce.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
-
nextKeyValue
public boolean nextKeyValue() throws java.io.IOException
- Specified by:
nextKeyValue
in classorg.apache.hadoop.mapreduce.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
- Throws:
java.io.IOException
-
next
public boolean next(java.lang.Long key, com.datastax.driver.core.Row value) throws java.io.IOException
- Specified by:
next
in interfaceorg.apache.hadoop.mapred.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
- Throws:
java.io.IOException
-
getPos
public long getPos() throws java.io.IOException
- Specified by:
getPos
in interfaceorg.apache.hadoop.mapred.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
- Throws:
java.io.IOException
-
createKey
public java.lang.Long createKey()
- Specified by:
createKey
in interfaceorg.apache.hadoop.mapred.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
-
createValue
public com.datastax.driver.core.Row createValue()
- Specified by:
createValue
in interfaceorg.apache.hadoop.mapred.RecordReader<java.lang.Long,com.datastax.driver.core.Row>
-
getNativeProtocolVersion
public int getNativeProtocolVersion()
Return native version protocol of the cluster connection- Returns:
- serialization protocol version.
-
-