top button
Flag Notify
    Connect to us
      Site Registration

Site Registration

MongoDb aggregation 16MB buffer size limit

+2 votes
250 views

Please tell me how can we resolve this issue, we are using aggregation and size of docs become greater than 16MB. We also tried "ALLOWDISKUSE = TRUE" but still its throwing same error.

We are using php to fetch data greater than 16MB. Let me know if you needed more info.

posted Dec 24, 2015 by anonymous

Looking for an answer?  Promote on:
Facebook Share Button Twitter Share Button LinkedIn Share Button
Change your aggregation so you are not constructing documents bigger than 16MBs.
We cant change aggregation, as data will grow, of-course we will have more data, we need some solution for this, not change of aggregation.
Can you not use $out stage to write the output data to a separate collection.  

Similar Questions
+1 vote

We are using mongo DB in a single node. I understand that this is not MongoDB is intended to do. But due to the sophistication of mongos querying and other architectural/ business reasons we have chosen MongoDB. We are facing an issue now. We would be happy to get it resolved with your help.

Problem:
We have to limit the memory utilization of MongoDB.

ENV:
WindowsVersion: 3.2

What we know:
1. MongoDB utilizes as much memory as possible to give a better performance
2. When memory utilization reaches a certain threshold percentage, MongoDB frees up the memory it holds
3. We are not able to see the memory utilization of MongoDB service in Task Manager

+2 votes

Is there a way to configure/increase the memory limit(100MB) on the pipeline? What if I have a lot of RAM that can be used by MongoDB?

0 votes

I have an aggregation query given below which I need to pass in as a json string to java app to execute it. Is it possible to do that -

{$unwind:$results},{$match:{result.studentid:11}}

I tried using BasicDBObject.parse but it is returning me the unwinded or flattened results and the result is not segregating on the basis of match.

Is there any other way to do it.

...