English 中文(简体)
向Hadoop Mapper发送任何类型的物体
原标题:Passing objects of any type to Hadoop Mapper
  • 时间:2012-05-07 22:25:32
  •  标签:
  • hadoop
  • hdfs

had形构造只允许在固定方法中显示为价值。

缩略语

是否容易确定任何其他物体类型? 我想在地图上检索这些物体。

我注意到,在0.15版本中,有一套(关键、目标价值)方法,后来被折旧和删除。 为什么这样做? 是否有其他办法让我把物体交给地图编辑?

问题回答

The configuration object has to be serialized to a string and sent to the mappers as a file with strings in it. You need to provide a way to serialize and deserialize your objects.





相关问题
Hadoop - namenode is not starting up

I am trying to run hadoop as a root user, i executed namenode format command hadoop namenode -format when the Hadoop file system is running. After this, when i try to start the name node server, it ...

What default reducers are available in Elastic MapReduce?

I hope I m asking this in the right way. I m learning my way around Elastic MapReduce and I ve seen numerous references to the "Aggregate" reducer that can be used with "Streaming" job flows. In ...

Establishing Eclipse project environment for HadoopDB

I have checked-out a project from SourceForge named HadoopDB. It uses some class in another project named Hive. I have used Eclipse Java build path setting to link source to the Hive project root ...

Hadoop: intervals and JOIN

I m very new to Hadoop and I m currently trying to join two sources of data where the key is an interval (say [date-begin/date-end]). For example: input1: 20091001-20091002 A 20091011-20091104 ...

hadoop- determine if a file is being written to

Is there a way to determine if a file in hadoop is being written to? eg- I have a process that puts logs into hdfs. I have another process that monitors for the existence of new logs in hdfs, but I ...

Building Apache Hive - impossible to resolve dependencies

I am trying out the Apache Hive as per http://wiki.apache.org/hadoop/Hive/GettingStarted and am getting this error from Ivy: Downloaded file size doesn t match expected Content Length for http://...

热门标签