druid集群部署问题

超、凢脫俗 2022-07-16 13:11 276阅读 0赞

**一、问题描述**

2016-03-09T15:01:54,938 ERROR \[task-runner-0-priority-0\] io.druid.indexing.overlord.ThreadPoolTaskRunner - Exception while running task\[HadoopIndexTask\{id=index\_hadoop\_wikipedia\_2016-03-09T15:00:28.895+01:00, type=index\_hadoop, dataSource=wikipedia\}\]  
java.lang.RuntimeException: java.lang.reflect.InvocationTargetException  
        at com.google.common.base.Throwables.propagate(Throwables.java:160) ~\[guava-16.0.1.jar:?\]  
        at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:171) ~\[druid-indexing-service-0.9.0-rc2.jar:0.9.0-rc2\]  
        at io.druid.indexing.common.task.HadoopIndexTask.run(HadoopIndexTask.java:208) ~\[druid-indexing-service-0.9.0-rc2.jar:0.9.0-rc2\]  
        at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:338) \[druid-indexing-service-0.9.0-rc2.jar:0.9.0-rc2\]  
        at io.druid.indexing.overlord.ThreadPoolTaskRunner$ThreadPoolTaskRunnerCallable.call(ThreadPoolTaskRunner.java:318) \[druid-indexing-service-0.9.0-rc2.jar:0.9.0-rc2\]  
        at java.util.concurrent.FutureTask.run(FutureTask.java:262) \[?:1.7.0\_75\]  
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) \[?:1.7.0\_75\]  
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) \[?:1.7.0\_75\]  
        at java.lang.Thread.run(Thread.java:745) \[?:1.7.0\_75\]  
Caused by: java.lang.reflect.InvocationTargetException  
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~\[?:1.7.0\_75\]  
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~\[?:1.7.0\_75\]  
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~\[?:1.7.0\_75\]  
        at java.lang.reflect.Method.invoke(Method.java:606) ~\[?:1.7.0\_75\]  
        at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:168) ~\[druid-indexing-service-0.9.0-rc2.jar:0.9.0-rc2\]  
        ... 7 more  
Caused by: com.metamx.common.ISE: Job\[class io.druid.indexer.IndexGeneratorJob\] failed!  
        at io.druid.indexer.JobHelper.runJobs(JobHelper.java:343) ~\[druid-indexing-hadoop-0.9.0-rc2.jar:0.9.0-rc2\]  
        at io.druid.indexer.HadoopDruidIndexerJob.run(HadoopDruidIndexerJob.java:94) ~\[druid-indexing-hadoop-0.9.0-rc2.jar:0.9.0-rc2\]  
        at io.druid.indexing.common.task.HadoopIndexTask$HadoopIndexGeneratorInnerProcessing.runTask(HadoopIndexTask.java:261) ~\[druid-indexing-service-0.9.0-rc2.jar:0.9.0-rc2\]  
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) ~\[?:1.7.0\_75\]  
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57) ~\[?:1.7.0\_75\]  
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) ~\[?:1.7.0\_75\]  
        at java.lang.reflect.Method.invoke(Method.java:606) ~\[?:1.7.0\_75\]  
        at io.druid.indexing.common.task.HadoopTask.invokeForeignLoader(HadoopTask.java:168) ~\[druid-indexing-service-0.9.0-rc2.jar:0.9.0-rc2\]  
        ... 7 more  
2016-03-09T15:01:54,952 INFO \[task-runner-0-priority-0\] io.druid.indexing.worker.executor.ExecutorLifecycle - Task completed with status: \{

原因分析：hadoop-dependencies/hadoop-client/2.3.0下的依赖包jackson-core-asl-1.9.13.jar、jackson-mapper-asl-1.9.13.jar和lib下的依赖包冲突引起的

解决办法：删除掉lib下的jackson-core-asl-1.9.13.jar和jackson-mapper-asl-1.9.13.jar依赖包，把hadoop-dependencies/hadoop-client/2.3.0下这两个依赖包copy过去即可。

**二、问题描述**

查询数据得不到结果？？？

解决办法：加载数据要加载到overload节点，查询数据要从broker节点查询。