Issue2108

Dear all,

I would like to run pyflakes under Jython (to do live syntax analysis on Python files inside an editor written in Java).

Unfortunately, pyflakes does not run with Jython. When running the following inside Jython:

    from pyflakes.api import check
    check("a = 1", "untitled.py")

I get the following:

Traceback (most recent call last):
  File "/Users/tlecomte/Documents/20131224_pyflakes/test_pyflakes.py", line 2, in <module>
    check("a = 1", "untitled.py")
  File "/Users/tlecomte/Src/icy-git/Icy-App/plugins/Lib/site-packages/pyflakes/api.py", line 58, in check
    w = checker.Checker(tree, filename)
  File "/Users/tlecomte/Src/icy-git/Icy-App/plugins/Lib/site-packages/pyflakes/checker.py", line 253, in __init__
    self.handleChildren(tree)
  File "/Users/tlecomte/Src/icy-git/Icy-App/plugins/Lib/site-packages/pyflakes/checker.py", line 520, in handleChildren
    self.handleNode(node, tree)
  File "/Users/tlecomte/Src/icy-git/Icy-App/plugins/Lib/site-packages/pyflakes/checker.py", line 551, in handleNode
    node.level = self.nodeDepth
AttributeError: '_ast.Assign' object has no attribute 'level'



Note that pyflakes tries to set a new attribute on 'node', which is a '_ast.Assign' object, i.e. subclass of _ast.AST and PythonTree. These are java classes deriving from PyObject and do not have a __dict__.

Under CPython, _ast.AST() shows the same behaviour, BUT all its subclasses (including '_ast.Assign') seem to allow the setting of new attributes. So it would be great if it was the same under Jython.

I am willing to help, but I am afraid I do not understand well enough the inner workings of PyObject in Jython...

Best regards,

Timothée

Hi Timothée - this is definitely my area :) -- is there any chance that you could provide an example that narrows things down to a simple test that doesn't depend on pyflakes? That would definitely speed me up on looking at this.

I have a fix in mind that amounts to a partial re-write of the whole ast implementation (something that needs to happen someday), but I'm hoping to find a simpler path.

The ast code generation has rotted a bit since I touched it last, so I'm doing some cleaning before I can really start on this. I really want to find a way to solve this and related problems - you are not the first to run into trouble here.

Hi Frank,

Thanks for your answer ! Here is a narrowed-down example:

This is on CPython, for reference:

$ python
Python 2.7.5 (default, Aug 28 2013, 10:09:22) 
[GCC 4.2.1 (Apple Inc. build 5666) (dot 3)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import _ast
>>> m = _ast.Module()
>>> m.level = 1
>>> m.level
1

and now with Jython:

>>> import _ast
>>> m = _ast.Module()
>>> m.level = 1
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
AttributeError: '_ast.Module' object has no attribute 'level'


P.S. : I also noticed another difference with _ast.AST(), but it is not a problem with pyflakes:

On CPython:
Python 2.7.5 (default, Aug 28 2013, 10:09:22) 
[GCC 4.2.1 (Apple Inc. build 5666) (dot 3)] on darwin
Type "help", "copyright", "credits" or "license" for more information.
>>> import _ast
>>> a = _ast.AST()
>>> a
<_ast.AST object at 0x1003430a0>
>>>

On Jython:
>>> import _ast
>>> a = _ast.AST()
Traceback (most recent call last):
  File "<stdin>", line 1, in <module>
TypeError: cannot create '_ast.AST' instances
>>>

Thanks for the example, that will help!

Fixed in trunk as of http://hg.python.org/jython/rev/ecb9475b7808