English 中文(简体)
放映一部关于 t的DVD。 记忆问题
原标题:Performing a SVD on tweets. Memory problem

EDIT:我的发言人数比我写的要大10-20倍。 我只是放弃零。

EDIT2:我将研究DVDLIBC,并研究如何将矩阵缩小到其密集版本中,这样也会有所帮助。

作为我的主角和根基所产生的产出,我产生了巨大的卷宗。 它希望:

        word1, word2, word3, ..., word 150.000
person1   1      2      0            1
person2   0      0      1            0
...
person650

其中载有每个人的字数。 同我一样,我正在成为每个人的典型病媒。

我想在这一节点上播放一个DVD,但似乎太大要留意来开展行动。 我的任务是:

  • i 删除一栏总和,即只使用过一次的字句,从而减少一栏的大小。 我是否把数据与这一企图混为一谈?

  • 我尝试了越演越烈的尝试,把 c装到 d。 之后,如快速采矿公司提议的那样,用批量进行加工。 但是,Mysql可以把许多一栏储存在一张桌上。 如果是转换数据,然后在进口时重新转换数据,则也需要年龄。

—— 因此,一般而言,我要求就如何执行有关这种保护状提出建议。

问题回答

这是一个高度密集的矩阵。 然而,它只是一个小小小块的矩阵。

利用零散的矩阵SVD算法即可。 e.g. here

DVD受你的记忆规模的制约。 见:

Folding In: a paper on part Update.

Apache Mahout是分布式数据采矿图书馆,该图书馆有平行的SVD





相关问题
Matrix to Represent a Triangle in Screen Space

So i have a set of four points in 3D Space. P1 [0, 0, 0] P2 [128, 0, 0] P3 [0, 128, 0] P4 [128, 128, 0] Which I m then projecting orthographically to the screen effectively giving me two ...

Multiply a 3D matrix with a 2D matrix

Suppose I have an AxBxC matrix X and a BxD matrix Y. Is there a non-loop method by which I can multiply each of the C AxB matrices with Y?

matrix and vector template classes in c++

#include <array> template <typename T> class Vector4<T> { std::array<T, 4> _a; // or T _a[4]; ? }; template <typename T> class Matrix4<T> { std::array<...

Linear Independence Matrix

Suppose we have a m by n matrix A with rank m and a set K⊆{1..n} such that the columns of A indexed by K are linearly independent. Now we want to extend K and find a set L so that k⊆L and columns ...

Difference between MATLAB s matrix notations

How do you read the following MATLAB codes? #1 K>> [p,d]=eig(A) // Not sure about the syntax. p = 0.5257 -0.8507 -0.8507 -0.5257 d = ...

Strange error when using sparse matrices and glmnet

I m getting a weird error when training a glmnet regression. invalid class "dgCMatrix" object: length(Dimnames[[2]]) must match Dim[2] It only happens occasionally, and perhaps only under larger ...

Java large datastructure for storing a matrix

I need to store a 2d matrix containing zip codes and the distance in km between each one of them. My client has an application that calculates the distances which are then stored in an Excel file. ...

Checking row and column for a word in python

I am trying to create a checking program to see if the word is in a matrix horizontally or vertically. I have the code for checking the row, but would checking the column be similar to the row code? ...

热门标签