CODEWITHSUNDEEP
mysql
vick
vick

Reputation: 19

mysql does not utilize my cpu and ram enough?

I am importing a 2.5gb csv file to a mysql table. My storage engine is innodb. Here is the script:

use xxx;
DROP TABLE IF EXISTS `xxx`.`xxx`;
CREATE TABLE  `xxx`.`xxx` (
  `xxx_id` int(10) unsigned NOT NULL AUTO_INCREMENT,
  `name` varchar(128) NOT NULL,
  `yy` varchar(128) NOT NULL,
  `yyy` varchar(64) NOT NULL,
  `yyyy` varchar(2) NOT NULL,
  `yyyyy` varchar(10) NOT NULL,
  `url` varchar(64) NOT NULL,
  `p` varchar(10) NOT NULL,
  `pp` varchar(10) NOT NULL,
  `category` varchar(256) NOT NULL,
  `flag` varchar(4) NOT NULL,
  PRIMARY KEY (`xxx_id`)
) ENGINE=InnoDB DEFAULT CHARSET=latin1;
set autocommit = 0;
load data local infile '/home/xxx/raw.csv' 
into table company
fields terminated by ',' optionally enclosed by '"'
lines terminated by '\r\n'
(
  name,
  yy,
  yyy,
  yyyy,
  yyyyy,
  url,
  p,
  pp,
  category,
  flag
);
commit;

Why does my PC (core i7 920 with 6gb ram) only consume 9% cpu power and 60% ram when running these queries?

Upvotes: 1

Views: 703

Answers (2)

David Z
David Z

Reputation: 131620

Probably because it's an I/O bound process. That means that the slowest part of the process is reading the CSV file from the disk and writing the MySQL database back to the disk. Disk access is much slower than pretty much anything else that goes on inside the computer, so your CPU probably only needs a few percent usage to keep up with it.

Also, MySQL is copying the data in a piece at a time, not all at once, so it only needs to store a little bit at a time in RAM. That's why it might not be using a whole lot of memory.

Upvotes: 8

Cade Roux
Cade Roux

Reputation: 89701

Because it's not really a CPU or memory operation, it's mainly a disk I/O operation?

Upvotes: 1

Related Questions