我是亚马孙地图的新东西。 谁能告诉我,如何容易地向亚马孙的SQS(简单的轮班)传递一个信息? 我想把我的工作S3成果提到SQS,以便更简单的自动检索。
I don t think you can call SQS from HIVE itself, however, you can create a script (as Steve suggested) that will call SQS and Hive. You can call SQS before the Hive script start as well as after the Hive job has ended with a pointer to where the result is stored (or will be stored).
另一种可能的办法:
创建新的Dynamo DB table; set up a lambda that will promote an SQS on each new items using SQS streams
页: 1 参考,每当你想要推动SQS时,在表格中插入一个记录。
I m trying to run some hadoop program to extracting keywords of some abstracts in Ubuntu. When I run my program using Hadoop, I get the following error. WARN util.NativeCodeLoader: Unable to load ...
When I run a mapreduce program using Hadoop, I get the following error. 10/01/18 10:52:48 INFO mapred.JobClient: Task Id : attempt_201001181020_0002_m_000014_0, Status : FAILED java.io.IOException:...
I m looking at building some data warehousing/querying infrastructure, right now on top of Map/Reduce solutions like Hadoop. However, it strikes me that all the M/R work is just repeating what the ...
When I executed a MapReduce program in Eclipse using Hadoop, I got the below error. It has to be some change in path, but I m not able to figure it out. Any idea? 16:35:39 INFO mapred.JobClient: Task ...
I am working on a project that deals with analyzing a very large amount of data, so I discovered MapReduce fairly recently, and before i dive any further into it, i would like to make sure my ...
I m about to start a mapreduce project which will run on AWS and I am presented with a choice, to either use Java or C++. I understand that writing the project in Java would make more functionality ...
I hope I m asking this in the right way. I m learning my way around Elastic MapReduce and I ve seen numerous references to the "Aggregate" reducer that can be used with "Streaming" job flows. In ...
I m doing some work to analyse the access logs from a Catalyst web application. The data is from the load balancers in front of the web farm and totals about 35Gb per day. It s stored in a Hadoop HDFS ...
