Skip to content Skip to sidebar Skip to footer
Home / Multiprocessing / Pandas / Pathos / Python 2.7

Cpickle Error While Using Pathos.multiprocessing?

Post a Comment
I'm trying to use multiprocessing to speed up pandas excel reading. However when I use multiprocessing I'm getting the error cPickle.PicklingError: Can't pickle : attribute lookup

Solution 1:

It is possible that Pandas may be using Swig as a wrapper for C code. If this is the case, then dill may not work properly, and pathos would then switch to pickle. There are workarounds, as shown here: How to make my SWIG extension module work with Pickle?


Post a Comment for "Cpickle Error While Using Pathos.multiprocessing?"