Question

I have a large CSV file, approx 10 MB in size, which contains all the data which need to be imported in the Google App Engine DataStore. I tried following approaches to perform import but all the times it failed in half way.

Import using mapping a command to url and then executing url, failed because of request time out...
Import using creating cron job, but got DeadlineExceededError...
Import using remort_api_shell, but got Operation timed out.

请建议我和 app(使用你可以想象的 du数据)如何做。提出守则将更有帮助。

** 本文件迟交。我正在利用沙尔和奥古格尔的网络评估框架开发上述数据。

Answer 1

您可以连任。使用散装装载机建造。

http://code.google.com/appengine/docs/python/tools/uploadingdata.html”rel=“nofollow noreferer”>http://code.google.com/appengine/docs/python/tools/uploadingdata.html

这是好的条款。

这里是我的联络员。 py i在两年前用于参考。它是自上次使用以来更为复杂的,但至今仍在使用。

import datetime
from google.appengine.ext import db
from google.appengine.tools import bulkloader

class Contact(db.Model):

    date = db.DateTimeProperty(auto_now_add=True)

    owner = db.StringProperty()

    companyname = db.StringProperty()

    companyemail = db.EmailProperty()

def myfunc(x):
    temp = x.split(":mailto:")
    if len(temp) > 0:
        temp = temp[-1].split(":")
    else:
        return "defaultvalue"
    if len(temp) > 0:
        temp = temp[0]
    else:
        return "defaultvalue"
    temp = temp.split("<1>")[0]
    if temp is None or len(temp) < 5:
        return "defaultvalue"
    return temp

def mysecfunc(x):
    return x.split("<0>")[0]

class ContactLoader(bulkloader.Loader):
    def __init__(self):
        bulkloader.Loader.__init__(self,  Contact ,
                                   [
                                    ( companyname ,mysecfunc),
                                    ( owner , lambda x:"somevalue"),
                                    ( companyemail ,myfunc),
                                    ("date",lambda x:datetime.datetime.now()),
                                   ])

loaders = [ContactLoader]

友情链接