delex.storage.hash_map package
Submodules
delex.storage.hash_map.hash_map_base module
- class delex.storage.hash_map.hash_map_base.DistributableHashMap(arr)
Bases:
SparkDistributable- Attributes:
- on_spark
Methods
deinit()deinitialize the object, closing resources (e.g. file handles).
init()initialize the object to be used on in a spark worker
to_spark()send the obj to the spark cluster to be used on spark workers
size_in_bytes
- deinit()
deinitialize the object, closing resources (e.g. file handles)
- init()
initialize the object to be used on in a spark worker
- property on_spark
- size_in_bytes() int
- to_spark()
send the obj to the spark cluster to be used on spark workers
delex.storage.hash_map.id_int_map module
- class delex.storage.hash_map.id_int_map.IdOffsetHashMap(arr)
Bases:
DistributableHashMap- Attributes:
- on_spark
Methods
build(longs, ints[, load_factor])deinit()deinitialize the object, closing resources (e.g. file handles).
init()initialize the object to be used on in a spark worker
to_spark()send the obj to the spark cluster to be used on spark workers
size_in_bytes
- classmethod build(longs, ints, load_factor=0.5)
- delex.storage.hash_map.id_int_map.hash_map_get_key(arr, key)
- delex.storage.hash_map.id_int_map.hash_map_get_keys(arr, keys)
- delex.storage.hash_map.id_int_map.hash_map_insert_key(arr, key, val)
- delex.storage.hash_map.id_int_map.hash_map_insert_keys(arr, keys, vals)
delex.storage.hash_map.string_int_map module
- class delex.storage.hash_map.string_int_map.StringIntHashMap(arr, hash_func)
Bases:
DistributableHashMap- Attributes:
- on_spark
Methods
deinit()deinitialize the object, closing resources (e.g. file handles).
init()initialize the object to be used on in a spark worker
to_spark()send the obj to the spark cluster to be used on spark workers
build
size_in_bytes
- classmethod build(strings, ints, load_factor=0.5)