Class SentenceStream`Abstract`

Hierarchy (view full)

SentenceStream
- BufferedSentenceStream

Index

Constructors

Accessors

Methods

[asyncIterator] close endInput flush next pushText

Constructors

constructor

new SentenceStream(): SentenceStream
Returns SentenceStream

Accessors

closed

get closed(): boolean
Returns boolean
- Defined in tokenize/tokenizer.ts:33

Methods

[asyncIterator]

[asyncIterator](): SentenceStream
Returns SentenceStream
- Defined in tokenize/tokenizer.ts:81

close

close(): void
Close both the input and output of the tokenizer stream

Returns void
- Defined in tokenize/tokenizer.ts:75

endInput

endInput(): void
Mark the input as ended and forbid additional pushes

Returns void
- Defined in tokenize/tokenizer.ts:60

flush

flush(): void
Flush the tokenizer, causing it to process all pending text

Returns void
- Defined in tokenize/tokenizer.ts:49

next

next(): Promise<IteratorResult<TokenData, any>>
Returns Promise<IteratorResult<TokenData, any>>
- Defined in tokenize/tokenizer.ts:70

pushText

pushText(text): void
Push a string of text to the tokenizer
Parameters
- text: string
Returns void
- Defined in tokenize/tokenizer.ts:38