English 中文(简体)
• 如何更快速地利用Twitter Campo 来收集Tweets?
原标题:How to Collect Tweets More Quickly Using Twitter API in Python?

在一项研究项目中,我正在利用Twitter收集陶瓷。 然而,当我们不停在一个单一计算机上运行一个星期时,我们只能每周收集大约20个甲基溴数据。 我只用一台机器执行这一方案,这样我们不会两次收集同样的信条。

我们的方案每60秒钟就有一个叫到公共时间的通道。 我试图通过在公开时限内向一些用户发出Usertimeline()电话来改进这一状况。 然而,这始终令我禁止每次大约半小时收集 t。 即便没有禁令,通过增加这一法典似乎进展甚微。

I know about Twitter s "whitelisting" that allows a user to submit more requests per hour. I applied for this about three weeks ago, and have not hear back since, so I am looking for alternatives that will allow our program to collect tweets more efficiently without going over the standard rate limit. Does anyone know of a faster way to collect public tweets from Twitter? We d like to get about 100 MB per week.

感谢。

问题回答

如何使用

我也开展了一个类似的项目,分析来自信条的数据。 如果你只是从纯粹的数据收集/分析的角度来回来,你就能够出于各种原因拆除收集这些信条的任何更好的地点。 很多地方允许你用 has子进行搜索,这样就向一个足够宽广的猎物扔 throw,你们会取得数千成果。 我只是为了公众的标签而拆除了其中几个场所,将这些场所收集到一个大名单,把该名单排在网站上,并从结果中删除了所有可用信息。 一些网站还允许你直接出口数据,使这项任务更加容易。 你们的垃圾会得到很多可能需要过滤的垃圾(垃圾邮件、外语等),但这是我们项目最快的方式。 推特可能不会给予你以白名单的地位,因此我肯定不会指望这样做。





相关问题
Can Django models use MySQL functions?

Is there a way to force Django models to pass a field to a MySQL function every time the model data is read or loaded? To clarify what I mean in SQL, I want the Django model to produce something like ...

An enterprise scheduler for python (like quartz)

I am looking for an enterprise tasks scheduler for python, like quartz is for Java. Requirements: Persistent: if the process restarts or the machine restarts, then all the jobs must stay there and ...

How to remove unique, then duplicate dictionaries in a list?

Given the following list that contains some duplicate and some unique dictionaries, what is the best method to remove unique dictionaries first, then reduce the duplicate dictionaries to single ...

What is suggested seed value to use with random.seed()?

Simple enough question: I m using python random module to generate random integers. I want to know what is the suggested value to use with the random.seed() function? Currently I am letting this ...

How can I make the PyDev editor selectively ignore errors?

I m using PyDev under Eclipse to write some Jython code. I ve got numerous instances where I need to do something like this: import com.work.project.component.client.Interface.ISubInterface as ...

How do I profile `paster serve` s startup time?

Python s paster serve app.ini is taking longer than I would like to be ready for the first request. I know how to profile requests with middleware, but how do I profile the initialization time? I ...

Pragmatically adding give-aways/freebies to an online store

Our business currently has an online store and recently we ve been offering free specials to our customers. Right now, we simply display the special and give the buyer a notice stating we will add the ...

Converting Dictionary to List? [duplicate]

I m trying to convert a Python dictionary into a Python list, in order to perform some calculations. #My dictionary dict = {} dict[ Capital ]="London" dict[ Food ]="Fish&Chips" dict[ 2012 ]="...

热门标签