English 中文(简体)
两名地图绘制者向同一档案撰写
原标题:Writing to the same file from two mappers
  • 时间:2012-01-14 08:21:43
  •  标签:
  • hadoop

在Hadoop MR(主要是民盟)中,是否有可能以同步/空中的方式从属于单一工作的两名地图绘制到同一档案中?

另外,还写给两台按序列顺序从事不同工作的地图绘制的单一档案?

在其他档案系统中也有烟雾。 克民盟的机制是什么?

问题回答
  1. Hadoop地图任务之间没有沟通,因此不可能在地图任务之间保持某种同步。

  2. 《人类发展报告》中的文件可由一位作者撰写,而许多读者可以阅读。

  3. I think MapR allows multiple writers to the same file.

日 本书必须附在尾,任何任意抵消也不可能改动。

Just curious, what is the use case for multiple map tasks writing to a single file?

Set the number or reducers = 1 (mapred.reduce.tasks=1)





相关问题
Hadoop - namenode is not starting up

I am trying to run hadoop as a root user, i executed namenode format command hadoop namenode -format when the Hadoop file system is running. After this, when i try to start the name node server, it ...

What default reducers are available in Elastic MapReduce?

I hope I m asking this in the right way. I m learning my way around Elastic MapReduce and I ve seen numerous references to the "Aggregate" reducer that can be used with "Streaming" job flows. In ...

Establishing Eclipse project environment for HadoopDB

I have checked-out a project from SourceForge named HadoopDB. It uses some class in another project named Hive. I have used Eclipse Java build path setting to link source to the Hive project root ...

Hadoop: intervals and JOIN

I m very new to Hadoop and I m currently trying to join two sources of data where the key is an interval (say [date-begin/date-end]). For example: input1: 20091001-20091002 A 20091011-20091104 ...

hadoop- determine if a file is being written to

Is there a way to determine if a file in hadoop is being written to? eg- I have a process that puts logs into hdfs. I have another process that monitors for the existence of new logs in hdfs, but I ...

Building Apache Hive - impossible to resolve dependencies

I am trying out the Apache Hive as per http://wiki.apache.org/hadoop/Hive/GettingStarted and am getting this error from Ivy: Downloaded file size doesn t match expected Content Length for http://...

热门标签