top button
Flag Notify
    Connect to us
      Site Registration

Site Registration

Mongodb bulk upsert with long pauses

0 votes
120 views

I have a script that bulk upserts batches of 1000s into a sharded cluster, as well as in a replica set. In the beginning, everything worked fine but after a while, the script kept pausing for seconds, now minutes and even hours, before it continues to run.

I have monitored the db servers and the CPU seems to be busy, but there is no I/O during the pauses. My guess is that its creating indexes so I tried monitoring the index creation process but with no luck.

So I am kind of stuck and don't know where to look next, any hint is greatly appreciated!

Also on http://stackoverflow.com/questions/36986559/mongodb-bulk-upsert-with-long-pauses

posted May 3, 2016 by anonymous

Looking for an answer?  Promote on:
Facebook Share Button Twitter Share Button LinkedIn Share Button

Similar Questions
0 votes
Reading bulk data in Mongo DB

I am using Mongo DB.One of the collection has multiple arrays of json (nested loop) around 200 lines. My Mongo DB is hosted in AWS.
Currently I am creating java script to fetch simple json data in collection. Can you suggest any tool to fetch bulk data collection and implement logic.

0 votes
MongoDB: update a nested object with {"env":"qa"} in my updated collection with java-driver:

My collection is like this, but I want to update a nested object with {"env":"qa"} in my updated collection with java-driver:

{ "_id" : ObjectId("5b052eeff9290437b217b1ed"), "app" : "hike", "group" : [ { "env" : "prod" }, { "env" : "test" } ]}{ "_id" : ObjectId("5b052f36f9290437b217b1ee"), "app" : "viber", "group" : [ { "env" : "prod" }, { "env" : "test" } ]}

...