Burf2000
Burf2000

Reputation: 5193

MongoDB Limits : Slow to insert records after 250 million

So I have installed the latest MongoDb on to a Windows 2016 server, it has been going like grease lighting up until I hit around 250 million records (2 fields, URL, body text, 1 index on the URL), now inserting takes a lot longer (from seconds to minutes).

Fast disks (SAN), plenty of ram (it's using 64gb out of 128gb), is there some sort of limit?

My aim is to insert 2.8 billion records.

Mongo 4.2 Windows Server 2016 DC

enter image description here enter image description here The data is simply ID/URL/Body index on URL

CFG (default)

mongod.conf

for documentation of all options, see:

http://docs.mongodb.org/manual/reference/configuration-options/

Where and how to store data. storage: dbPath: Z:\data journal:

enabled: true

engine:

mmapv1:

wiredTiger:

where to write logging data. systemLog: destination: file logAppend: true path: C:\Program

Files\MongoDB\Server\4.2\log\mongod.log

network interfaces net: port: 27017 bindIp: 192.168.0.150,127.0.0.1

processManagement:

security:

operationProfiling:

replication:

sharding:

Enterprise-Only Options:

auditLog:

snmp:

Upvotes: 1

Views: 703

Answers (1)

D. SM
D. SM

Reputation: 14490

is there some sort of limit?

MongoDB limits are described here.

MongoDB does not limit its own performance.

Upvotes: 1

Related Questions