English 中文(简体)
检查大型CSV文档(1m rows)是否有与MySQL表格相同的数据
原标题:Checking whether a large CSV file (1m rows) has the same data as a MySQL table
  • 时间:2012-04-16 01:15:38
  •  标签:
  • php
  • mysql
  • csv

我试图找到一种办法,将CSV档案内容与MySQL数据库(比较100万浏览器)进行高效比较,在把所有浏览器放在一个阵列之前,我做了一些模拟的工作,但由于记忆超负荷,它将为少数几行工作。

我的问题是,是否有这样做的可行办法? 任何图书馆或能够帮助的东西?

我对你的回答表示感激。

最佳回答
问题回答

除了“从哪里”的出色答案外,你还可以在MySQL和原始档案中计算出一 has,然后对二.进行比较。





相关问题
SQL SubQuery getting particular column

I noticed that there were some threads with similar questions, and I did look through them but did not really get a convincing answer. Here s my question: The subquery below returns a Table with 3 ...

please can anyone check this while loop and if condition

<?php $con=mysql_connect("localhost","mts","mts"); if(!con) { die( unable to connect . mysql_error()); } mysql_select_db("mts",$con); /* date_default_timezone_set ("Asia/Calcutta"); $date = ...

php return a specific row from query

Is it possible in php to return a specific row of data from a mysql query? None of the fetch statements that I ve found return a 2 dimensional array to access specific rows. I want to be able to ...

Character Encodings in PHP and MySQL

Our website was developed with a meta tag set to... <meta http-equiv="Content-Type" content="text/html; charset=iso-8859-1" /> This works fine for M-dashes and special quotes, etc. However, I ...

Pagination Strategies for Complex (slow) Datasets

What are some of the strategies being used for pagination of data sets that involve complex queries? count(*) takes ~1.5 sec so we don t want to hit the DB for every page view. Currently there are ~...

Averaging a total in mySQL

My table looks like person_id | car_id | miles ------------------------------ 1 | 1 | 100 1 | 2 | 200 2 | 3 | 1000 2 | 4 | 500 I need to ...