bugfix for partitioned deduplicate