Skip to content

Commit 03944c2

Browse files
mongoKartnorareidy
andcommitted
DOCSP-40130 - Note on Sharded Partitioner (#201)
Co-authored-by: Nora Reidy <[email protected]> (cherry picked from commit e25e13f)
1 parent 49e3ff0 commit 03944c2

File tree

1 file changed

+13
-3
lines changed

1 file changed

+13
-3
lines changed

source/batch-mode/batch-read-config.txt

Lines changed: 13 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -10,6 +10,13 @@ Batch Read Configuration Options
1010
:depth: 1
1111
:class: singlecol
1212

13+
.. facet::
14+
:name: genre
15+
:values: reference
16+
17+
.. meta::
18+
:keywords: partitioner, customize, settings
19+
1320
.. _spark-batch-input-conf:
1421

1522
Overview
@@ -212,9 +219,12 @@ based on your shard configuration.
212219
To use this configuration, set the ``partitioner`` configuration option to
213220
``com.mongodb.spark.sql.connector.read.partitioner.ShardedPartitioner``.
214221

215-
.. warning::
216-
217-
This partitioner is not compatible with hashed shard keys.
222+
.. important:: ShardedPartitioner Restrictions
223+
224+
1. In MongoDB Server v6.0 and later, the sharding operation creates one large initial
225+
chunk to cover all shard key values, making the sharded partitioner inefficient.
226+
We do not recommend using the sharded partitioner when connected to MongoDB v6.0 and later.
227+
2. The sharded partitioner is not compatible with hashed shard keys.
218228

219229
.. _conf-mongopaginatebysizepartitioner:
220230
.. _conf-paginatebysizepartitioner:

0 commit comments

Comments
 (0)