7 Commits

Author	SHA1	Message	Date
Dave Halter	b1f613fe16	Fix split lines for Python code ... Some characters like Vertical Tab or File Separator were used as line separators. This is not legal. Line Separators in Python are only Carriage Return \r and Line Feed \n.	2019-01-08 08:42:30 +01:00
Dave Halter	f4696a6245	Add \r as a valid linebreak for splitlines	2019-01-07 18:46:16 +01:00
Dave Halter	51f2de28c6	source_to_unicode -> python_bytes_to_unicode.	2017-08-15 20:07:24 +02:00
Dave Halter	ab027885c7	Refactor splitlines -> split_lines.	2017-08-15 19:54:21 +02:00
Dave Halter	859c48170e	Add the utf-8 bom to the prefix in the tokenizer.	2017-07-10 23:26:15 +02:00
Dave Halter	d6a781744d	Fix a small mistake.	2017-05-20 14:10:21 -04:00
Dave Halter	0bd16939f1	Add utils tests for splitlines and source_to_unicode.	2017-05-20 09:54:37 -04:00