processor: Catch SyntaxError also when generating tokens for a file
`tokenize.generate_tokens()` can also raise `SyntaxError` in addition to `tokenize.TokenError`.
Loading
Please register or sign in to comment
`tokenize.generate_tokens()` can also raise `SyntaxError` in addition to `tokenize.TokenError`.