Pickling of function pointer #157

Activity

1. NanoNabla commented on Feb 21, 2023

   

   NanoNabla

   on Feb 21, 2023

   CollaboratorAuthor

   More actions

   A more minimal example

   import pickle                                                                                                                                                                                                                                 
   
   def a(x):
       print(x)
   def b(x, y): 
         x(y) 
   def main():
       b(a,3)
       pickle.dumps(a) # without this pickle call everything works fine
   
   if __name__ == '__main__':
       main()
   
2. NanoNabla commented on Feb 28, 2023

   

   NanoNabla

   on Feb 28, 2023

   CollaboratorAuthor

   More actions

   The problem seems to be caused by some design decision made by python and a well known issue e.g. with using multiprocessing in interactive sessions.

   Functionality within this package requires that the main module be importable by the children. [...] This means that some examples, such as the multiprocessing.pool.Pool examples will not work in the interactive interpreter. For example: [from the multiprocessing docu]

   As a workaround until I find a proper solution I recommend as a workaround to put the code into a separate file than the one to call the python interpreter on

   e.g.

   # foo.py
   
   import pickle                                                                                                                                                                                                                                 
   
   def a(x):
       print(x)
   def b(x, y): 
         x(y) 
   def main():
       b(a,3)
       pickle.dumps(a) # without this pickle call everything works fine
   

   # bar.py
   
   import foo
   
   if __name__ == '__main__':
       foo.main()
   

   python -m scorep bar.py