I have lots of multiprocessing processes which have to add to and search in a dict. Deletion of values is not needed.

Atm I am using multiprocessing.Manager() and

dict = manager.dict()

This works pretty well, but I think that the manager is a huge bottleneck here. Any ideas? It has to run on older Python 3 versions, otherwise I would use this cool thing I found: https://github.com/ronny-rentner/UltraDict

@thann@heapoverflow.ml
mod
link
fedilink
17 Tage

Have you tested the throughput of dict.manager?
If you need big scale, there is always redis.

Ask specific questions about how to code something in python

Python docs (tutorial)
Intro to programming - University of Helsinki

General python discussion on lemmy.ml

Create Post From:
lemmy.ml

  • 0 users online
  • 1 user / day
  • 1 user / week
  • 3 users / month
  • 4 users / 6 months
  • 2 subscribers
  • 6 Posts
  • 9 Comments
  • Modlog