Hey,

following scenario:

My users have Tags, saved in an array (like "tag1", "tag2" ) and so on.

On the other collection the entitiys have also an array field containing tags. 

Now i want to compare these fields to match, the objects from the one collection to the tags from my user.

(and calculate how much percent they are matching)


Like:
User.tags: ['USA', 'Germany']

othercollection.tags : ['USA', 'Italy']


Should match and percentage is 50%.


Any idea how to solve this with mongodb? I don't really have a nice way or idea to achieve this on a smart way.


Help would be great!

Hi Nico,

You can achieve this using business logic.

E.g. If you need to get items from a collection with  at least 50% match with tags of currently logged in user, you could hit this custom endpoint created using Business Logic and it would return matching items from the collection. This particular endpoint will use javascript code with modules like collectionAccess for accessing the collection.

To get started with Business Logic, please refer to following documentation:

• http://devcenter.kinvey.com/android/guides/business-logic
  
• http://devcenter.kinvey.com/android/reference/business-logic/reference.html
  

I have to renew this.

I've read a bit thorugh the official docs of mongo db and found some stuff, not supported by kinvey. (Like aggregate)


I've come up with an example for my case - 

var queryAr = ["html"];
  
  coll('jobs').find({ tasks: {$in : queryAr} }, function(err, docs){
    
   // log(docs);
    for( var i = 0; i<docs.length; i++){
      log(docs[i].tasks);
    }
    
    
    response.complete(200);
  });

 So the idea is finding all jobs, where the tasks (an array of tags) at least contain the given one. Now i wanna turn that into a percentage value to show this to the user sorted by this value.


As i said i found some examples where they use $project together with aggregate to do this step by step, but since this is not available, any idea how to accomplish this?
At the moment I don't really see the answer for this.

Answer would be great.
Best, Nico

Hi Nico,

I was able to achieve the percentage calculations by constructing an "$or" query to get books (the other collection) with matching tags and by writing a loop to calculate the percentage per book.

function onRequest(request, response, modules) {
  modules.collectionAccess.collection('user').find({"username":request.username}, function (err, users){
    if (err) {
      modules.logger.error('Query failed: '+ err);
      response.body.debug = err;
      response.complete(500);
    } else {
      modules.logger.info(users[0].tags);
      var usertags = users[0].tags;
      var q = { "$or" : [] };
      for (each in usertags){
        q["$or"].push({"tags": usertags[each] });
      }
      modules.logger.info(q);
    	modules.collectionAccess.collection('BookCloud').find(q, function (err, docs) {
        if (err) {
          modules.logger.error('Query failed: '+ err);
          response.body.debug = err;
          response.complete(500);
        } else {
          modules.logger.info(docs);
          modules.logger.info(docs.length);
          var finalDocs = [];
          for (i in docs){
            var count = 0;
            for (j in usertags){
              if (docs[i]["tags"].indexOf(usertags[j]) > -1){
                count ++;
              }
            }
            modules.logger.info(count/usertags.length);
            if ((count/usertags.length) > 0.5){
              finalDocs.push(docs[i]);
            }
          }
          modules.logger.info(finalDocs.length);
          response.body = finalDocs;
          response.complete(200);
        }
      });
    }
  });
}

Let me know if this is useful.

Regards,

Wani

Hey Wani,

thanks for the quick and nice answer! :) Helps me a lot. Think i have to adjust 1,2 small things, but looking good.

One question ahead:

I do have the percentage (i will change it a bit), but how can i query for this value?


So that i can do something like "pull 20 results", sorted by percentage. So the one matching 100% are on the top, 0% is bottom.
I'm not "a backend guy" (as you can see ;) ) - isn't that to much stuff processed on the request?

Best, Nico

Hi,

have to "Push" this topic up, cause a blocker at the moment for our project.

Is there a way to acced more mongodb features within kinvey?

Best, Nico

Nico,

I will have Wani follow up on this tonight (He started the replies so I'm going to let him continue).  That said, apologies for the slow reply, he has been on vacation since Thursday of last week, but should be on in a few hours time.

Thanks,

Hey Damien,

no problem - I don't want to annoy anyone :)
Best, Nico

My apologies Nico I hope you didn't take it as that,

I just wanted to let you know why there was a delay in processing on our end. 

You're not a bother at all,

I don't - everything is fine = )

Hi Nico,

To get 20 results, sorted by percentage, you could modify the script I wrote to do two things:

• Add match percentage to each job entry
  

docs[i]["percentMatch"] = count/usertags.length;

• Sort the final output on this percentMatch property and select top 20

finalDocs.sort(function(a, b) {
    return parseFloat(a.percentMatch) - parseFloat(b.percentMatch);
});
finalDocs = finalDocs.slice(0,20);

1. Use the current approach (should work fine up to a limit)
2. Offload the "match" task to your nodeJS server and push results to kinvey collection
3. Use scheduled code feature of kinvey (http://devcenter.kinvey.com/android/tutorials/scheduled-code-getting-started) to do the "match" task periodically