Skip to content

Commit

Permalink
Merge branch 'master' into selitvin/remove_legacy
Browse files Browse the repository at this point in the history
  • Loading branch information
selitvin authored Apr 12, 2022
2 parents eea01f2 + 26e03c7 commit 16de47f
Show file tree
Hide file tree
Showing 3 changed files with 8 additions and 3 deletions.
7 changes: 6 additions & 1 deletion docs/release-notes.rst
Original file line number Diff line number Diff line change
Expand Up @@ -4,12 +4,17 @@
Release notes
=============

Release 0.11.4 (unreleased)
Release 0.11.5 (unreleased)
===========================


Release 0.11.4
===========================
- `PR 730 <https://github.com/uber/petastorm/pull/730>`_ (resolves `PR 724 <https://github.com/uber/petastorm/issues/724>`_): Hadoop 3 support: allow more than 2 nodenames in hadoop configuration file.
- `PR 731 <https://github.com/uber/petastorm/pull/731>`_ (resolves `PR 728 <https://github.com/uber/petastorm/issues/728>`_): Support passing multiple parquet dataset urls to make_reader.
- `PR 732 <https://github.com/uber/petastorm/pull/732>`_ (resolves `PR 585 <https://github.com/uber/petastorm/issues/585>`_): Restructure process_pool implementation code in a way that resolves ``RuntimeWarning: 'petastorm.workers_pool.exec_in_new_process' found in sys.modules after
import of package 'petastorm.workers_pool', but prior to execution of 'petastorm.workers_pool.exec_in_new_process'; this may result in unpredictable behaviou when using process pool`` warning.
- `PR 737 <https://github.com/uber/petastorm/pull/737>`_: Use highest available pickle protocol for internal serialization.


Release 0.11.3
Expand Down
2 changes: 1 addition & 1 deletion petastorm/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -16,4 +16,4 @@
from petastorm.reader import make_reader, make_batch_reader # noqa: F401
from petastorm.transform import TransformSpec # noqa: F401

__version__ = '0.11.3rc0'
__version__ = '0.11.4'
2 changes: 1 addition & 1 deletion petastorm/reader_impl/pickle_serializer.py
Original file line number Diff line number Diff line change
Expand Up @@ -17,7 +17,7 @@
class PickleSerializer(object):

def serialize(self, rows):
return pickle.dumps(rows)
return pickle.dumps(rows, protocol=pickle.HIGHEST_PROTOCOL)

def deserialize(self, serialized_rows):
return pickle.loads(serialized_rows)

0 comments on commit 16de47f

Please sign in to comment.