We running map reduce on 10 fields in a collection. In those 10 fields we have a growing array field. It was fine until the array size limited.
But when the array size became 100 and above, the mapreduce has stopped working. It is giving some exception saying array size is bigger.
Actual scenario :
MyDocument{
_I'd : 1234,
Name : some,
Email : somex@somedomain.com,
Age : 20,
Gender : female,
City : some city
Interests[1,2,3,4,5,6,7,8],
Status : active}
With mapreduce we are able to get all counts with all permutations and combinations.
But after interest array field becomes big, the mapreduce is not running.
If we remove that field and maintain it seperatly, we may not get counts based on gender age and interest.
Can any one suggest a better approach to this?