CODEWITHSUNDEEP
node.jsmongodb
monxas
monxas

Reputation: 2637

Very slow performance on mongodb find

I'm new with nodejs and mongodb. To test it out I captured 2.500.000 tweets from the #oscars. Now i'm playing a bit with the data, but find queries like the one below are extremely slow... (up to 40 seconds) (I'm doing the queries directly on console)

db.oscars.find({user.screen_name: "monxas"})

Am I doing something wrong? Is there anyway to speed up this queries?

tweets have this structure, if that helps:

 {
  "_id" : ObjectId("54ea1f0f5fbae7a02067024b"),
  "created_at" : "Sun Feb 22 18:25:20 +0000 2015",
  "id" : 5.6956360590721434E+17,
  "id_str" : "569563605907214338",
  "text" : "#Oscars2015 Who will win tonight? All hopes are on you guys.",
  "source" : "<a href=\"http://twitter.com/#!/download/ipad\" rel=\"nofollow\">Twitter for iPad</a>",
  "truncated" : false,
  "in_reply_to_status_id" : null,
  "in_reply_to_status_id_str" : null,
  "in_reply_to_user_id" : null,
  "in_reply_to_user_id_str" : null,
  "in_reply_to_screen_name" : null,
  "user" : {
    "id" : 2596742425.0,
    "id_str" : "2596742425",
    "name" : "jclivesforever26",
    "screen_name" : "jacuasay092600",
    "location" : "",
    "url" : null,
    "description" : "Da Bulls!!! Ed Sheeran is life!!!",
    "protected" : false,
    "verified" : false,
    "followers_count" : 21,
    "friends_count" : 183,
    "listed_count" : 0,
    "favourites_count" : 78,
    "statuses_count" : 283,
    "created_at" : "Mon Jun 30 18:13:13 +0000 2014",
    "utc_offset" : null,
    "time_zone" : null,
    "geo_enabled" : true,
    "lang" : "en",
    "contributors_enabled" : false,
    "is_translator" : false,
    "profile_background_color" : "C0DEED",
    "profile_background_image_url" : "http://abs.twimg.com/images/themes/theme1/bg.png",
    "profile_background_image_url_https" : "https://abs.twimg.com/images/themes/theme1/bg.png",
    "profile_background_tile" : false,
    "profile_link_color" : "0084B4",
    "profile_sidebar_border_color" : "C0DEED",
    "profile_sidebar_fill_color" : "DDEEF6",
    "profile_text_color" : "333333",
    "profile_use_background_image" : true,
    "profile_image_url" : "http://pbs.twimg.com/profile_images/542805253952135168/Ttwm541P_normal.jpeg",
    "profile_image_url_https" : "https://pbs.twimg.com/profile_images/542805253952135168/Ttwm541P_normal.jpeg",
    "profile_banner_url" : "https://pbs.twimg.com/profile_banners/2596742425/1421468064",
    "default_profile" : true,
    "default_profile_image" : false,
    "following" : null,
    "follow_request_sent" : null,
    "notifications" : null
  },
  "geo" : null,
  "coordinates" : null,
  "place" : null,
  "contributors" : null,
  "retweet_count" : 0,
  "favorite_count" : 0,
  "entities" : {
    "hashtags" : [{
        "text" : "Oscars2015",
        "indices" : [0, 11]
      }],
    "trends" : [],
    "urls" : [],
    "user_mentions" : [],
    "symbols" : []
  },
  "favorited" : false,
  "retweeted" : false,
  "possibly_sensitive" : false,
  "filter_level" : "low",
  "lang" : "en",
  "timestamp_ms" : "1424629520285"
}

Upvotes: 0

Views: 1848

Answers (1)

chridam
chridam

Reputation: 103335

Use the explain cursor method to find out more about the query plan

db.oscars.find({user.screen_name: "monxas"}).explain();

If there are no indexes defined then you can add one on user.screen_name to speed up the query using ensureIndex as follows 

db.oscars.ensureIndex({"user.screen_name": 1});

Upvotes: 4

Related Questions