[Python-Dev] tokenize.py (generate_tokens yielding @ as OP)

Simon Percivall s.percivall at chello.se
Mon Aug 9 22:10:40 CEST 2004


This is a question regarding the tokenize.generate_tokens function.

As it is in CVS HEAD, generate_tokens yields the '@' token as
having type OP, not type AT. Is this how it should be?

/Simon



More information about the Python-Dev mailing list

Follow Lee on X/Twitter - Father, Husband, Serial builder creating AI, crypto, games & web tools. We are friends :) AI Will Come To Life!

Check out: eBank.nz (Art Generator) | Netwrck.com (AI Tools) | Text-Generator.io (AI API) | BitBank.nz (Crypto AI) | ReadingTime (Kids Reading) | RewordGame | BigMultiplayerChess | WebFiddle | How.nz | Helix AI Assistant