from-beginning equivalent when using the client

The command line tool kafka-console-consumer.sh has the option --from-beginning. What is the client’s equivalent?

[matthewfranglen]

You can create a KafkaConsumer with the auto_offset_reset='smallest' keyword argument:

from kafka import KafkaConsumer

consumer = KafkaConsumer(
    'test',
    group_id='example',
    bootstrap_servers=['localhost:9092'],
    auto_offset_reset='smallest'
)

consumer.offsets()
{'commit': {('test', 0): None},
 'fetch': {('test', 0): 0},
 'highwater': {('test', 0): None},
 'task_done': {('test', 0): None}}

[jmess4]

auto_offset_reset only kicks in if the consumer does not have a valid offset for a given partition. If you don’t need a group you can set group_id=None to get the behavior you want. Otherwise you’ll need to manually assign partitions and then seek to beginning.