Nodechef.com returns only last object with valid data

[josefkaeufl]

Nodechef.com returns only last object with valid data

[milesrichardson]

Just guessing, but the problem is probably with deepcopy. It could also be with your method of reading lines. Try rewriting the loop like this:

class Url(Object):
    pass

arrayList = []

with open("Input.txt", "r") as fh:
    for idx, line in enumerate(fh.readlines()):
        arrayList.append(Url(idx=idx, url=line.strip()))

batcher = ParseBatcher()
batcher.batch_save(arrayList)

[josefkaeufl]

Works perfectly. Thanks!!!
But I don't understand why mine isn't... :)

[milesrichardson]

I take it you're new to Python, and coming from Swift it can look similar in syntax, but there are some crucial differences. I encourage you to read up on the fundamentals of Python and the idiosyncrasies of the language (e.g. Python is primarily pass by reference while Swift is pass by value unless explicitly instructed otherwise).

Your mistake here is abusing deepcopy. Try to avoid it as much as you can, because it's behavior on custom objects can be unpredictable. In the case of ParsePy, the code uses metaclass features which almost certainly cause problems with deepcopy. deepcopy is a serializing function for translating the "value" of the object according to a predefined set of rules, into another object. It's not much different than serializing to JSON. That means that for complex objects with strange behaviors, like those with inheriting from a metaclass, you need to write a custom function to override its default behavior. ParsePy does not have a deepcopy function implemented on its objects, so this is causing problems.

What was happening:

• Every iteration of the loop, you overwrote the region of memory where anyObject was stored.

• When you called arrayList.append(deepcopy(anyObject)), something about deepcopy failed to copy the object to a new region of memory (probably because parsepy has no __deepcopy__ method defined)

• The next iteration overwrote the memory region of the last iteration

• The last iteration was the only one to save because there was not an iteration after it to overwrite the value it appended to array.

Some other things:

• Best practice is to use the with open('filename.txt') as fh: when opening files.

• I avoided deepcopy by creating the object at time of assignment to function argument. You can create parse objects with keyword arguments rather than creating the object, then changing its values, then deep copying it. By doing this at the same time as assigning the object as the argument to append(), I avoid the need to do deepcopy.

[milesrichardson]

I highly suggest this guide: http://docs.python-guide.org/en/latest/