Segmentation fault from a script

The script I have produces a segmentation fault, any idea why?

import io
import spacy

from spacy.tokens.doc import Doc

def transform( in_file, out_file ):   

    global nlp

    with io.open( out_file, 'w', encoding='utf8') as o_f:
        with io.open( in_file, 'rb' ) as i_f:
            for byte_string in Doc.read_bytes( i_f ):
                doc = Doc( nlp.vocab ).from_bytes( byte_string )
                doc.is_parsed = True
                o_f.write(transform_doc( doc )) 


nlp = spacy.en.English( parser=False, tagger=False, matcher=False, entity=False )

transform( 'sample.txt', 'sample_out.txt' )

[zygmuntz]

Ah, the joys of copy-paste. Thank you for clarifying this.

Still, a message like “Attempted to read_bytes() from not-a-Doc-instance, terminating…” would be helpful. With another sample I just got a memory error.

[lock[bot]]

This thread has been automatically locked since there has not been any recent activity after it was closed. Please open a new issue for related bugs.