tree 2d2db18ce2b6c7f3c7ee3df6da68523aa812ede2
parent 2a1e6698b10a7b58c6ac66429de0f51cb739da35
author Pablo Galindo <Pablogsal@gmail.com> 1621721100 +0100
committer GitHub <noreply@github.com> 1621721100 +0100
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsBcBAABCAAQBQJgqYAMCRBK7hj4Ov3rIwAA3FQIAI+2jBphPsU4NGGuJhkwXhzw
 ah8qxt/tNhrgQlKRT1zUQy/MrIfmZ/t4cjDmhLj27tjJtkZ43sF7ECczZMIvHz82
 b70wNnjonIyFMUeVUGAqoG3ROiCXU8kpot9YSxysqz3t7YBsQxPjMZc6VXamOiql
 PR/irKL8t2Dyr4kq1PqTeux8qmIIV0dixtjzzAAn/mXdZdEqB6Z5APHMvUtXdb62
 cNmeL8J0pRAePCE3KYvhwNy0ALOoWf/swZiCJyXCAqdD4HLmQzA3+ec4OHyufxkD
 OW+eCvBJTqZoU4eTWR8HceWadk8pOLrN5K2O21ifVrL6269E/KalyEOK/TvlZWg=
 =qx4Z
 -----END PGP SIGNATURE-----
 

bpo-44201: Avoid side effects of "invalid_*" rules in the REPL (GH-26298)

When the parser does a second pass to check for errors, these rules can
have some small side-effects as they may advance the parser more than
the point reached in the first pass. This can cause the tokenizer to ask
for extra tokens in interactive mode causing the tokenizer to show the
prompt instead of failing instantly.

To avoid this, add a new mode to the tokenizer that is activated in the
second pass and deactivates asking for new tokens when the interactive
line is finished. As the parsing should have reached the last line in
the first pass, the second pass should not need to ask for more tokens.