English 中文(简体)
HBase MM 任务中找不到 动物管理员罐
原标题:zookeeper jar not found in HBase MR job

我有一个网络UI 试图在 HBase 桌上生成 MR 工作。

java.io.FileNotFoundException: File /opt/hadoop/mapreduce/system/job_201205251929_0007/libjars/zookeeper-3.3.2.jar does not exist.
        at org.apache.hadoop.fs.RawLocalFileSystem.getFileStatus(RawLocalFileSystem.java:361)
        at org.apache.hadoop.fs.FilterFileSystem.getFileStatus(FilterFileSystem.java:245)
        at org.apache.hadoop.filecache.DistributedCache.getTimestamp(DistributedCache.java:509)
        at org.apache.hadoop.mapred.JobClient.configureCommandLineOptions(JobClient.java:629)
        at org.apache.hadoop.mapred.JobClient.submitJobInternal(JobClient.java:761)
        at org.apache.hadoop.mapreduce.Job.submit(Job.java:432)
        at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:448)

我用HBase 0.90.4运行。HBase管理着自己的动物园管理员。而且,我确认在我的HDFS中,我有/opt/hadoop/hadoop/mapreduce/mapreduce/ system/job_2020052529_0007/libjars/zooctors/3.3.2.jar 。 它是否在本地FS中查看?

最佳回答

我发现我没有 核心地点.xml 在我的类路径上, 它用本地FS 代替 HDFS 。 罐头存在于 HDFS 中, 但是它正在寻找本地FS 。

问题回答

在映像器或递减器中访问的任何罐文件都需要在集中所有节点的本地文件系统中。 请检查您的本地 FS 。





相关问题
Hbase schema design -- to make sorting easy?

I have 1M words in my dictionary. Whenever a user issue a query on my website, I will see if the query contains the words in my dictionary and increment the counter corresponding to them individually. ...

How to pick random (small) data samples using Map/Reduce?

I want to write a map/reduce job to select a number of random samples from a large dataset based on a row level condition. I want to minimize the number of intermediate keys. Pseudocode: for each ...

Difference between Document-oriented-DB and Bigtable clones

Can someone give a head-to-head comparison between them? We are looking for a suitable storage engine for our weblog history data. We looked at Bigtable s paper and understand it is suitable to us ...

is this architecture possible in Hadoop MR?

Is the following architecture possible in Hadoop MapReduce? A distributed key-value store is used (HBase). So along with values, there would be a timestamp associated with the values. Map & ...

i got this exception while i run hbase client

import java.io.IOException; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.client.Get; import org.apache.hadoop.hbase.client.HTable; import org.apache.hadoop.hbase....

Any scalable OLAP database (web app scale)?

I have an application that requires analytics for different level of aggregation, and that s the OLAP workload. I want to update my database pretty frequently as well. e.g., here is what my update ...

Scalable Image Storage

I m currently designing an architecture for a web-based application that should also provide some kind of image storage. Users will be able to upload photos as one of the key feature of the service. ...

热门标签