Kafka produce or consume msg failed from windows clients to remote Linux servers -


i both download kafka_2.10-0.10.0.1 windows , linux machine(i have cluster has 3 linux machines ,192.168.80.128/129/130).so , use windows machine kafka client , linux machines kafka servers. try produce msg windows remote kafka server, command , response below:

f:\kafka_2.10-0.10.0.1\kafka_2.10-0.10.0.1\bin\windows>kafka-console-pr oducer.bat --broker-list 192.168.80.128:9092 --topic wuchang dadfasdf asdfasf [2016-11-08 22:41:30,311] error error when sending message topic wuchang  key: null, value: 8 bytes error: (org.apache.kafka.clients.producer.intern als.errorloggingcallback) org.apache.kafka.common.errors.timeoutexception: batch containing 2 record(s) ex pired due timeout while requesting metadata brokers wuchang-0 [2016-11-08 22:41:30,313] error error when sending message topic wuchang  key: null, value: 7 bytes error: (org.apache.kafka.clients.producer.intern als.errorloggingcallback) org.apache.kafka.common.errors.timeoutexception: batch containing 2 record(s) ex pired due timeout while requesting metadata brokers wuchang-0

i sure kafka cluster ok because run produce , consume command directly on linux server successfully.

ofcource , comsume msg remote kafka server failed:

f:\kafka_2.10-0.10.0.1\kafka_2.10-0.10.0.1\bin\windows>kafka-console-co nsumer.bat --bootstrap-server 192.168.80.128:9092 --topic wuchang --from-beginni ng --zookeeper 192.168.80.128:2181 [2016-11-08 22:56:43,486] warn fetching topic metadata correlation id 0  topics [set(wuchang)] broker [brokerendpoint(1,vm02,9092)] failed (kafka.c lient.clientutils$) java.nio.channels.closedchannelexception         @ kafka.network.blockingchannel.send(blockingchannel.scala:110)         @ kafka.producer.syncproducer.liftedtree1$1(syncproducer.scala:80)         @ kafka.producer.syncproducer.kafka$producer$syncproducer$$dosend(syncp roducer.scala:79)         @ kafka.producer.syncproducer.send(syncproducer.scala:124)         @ kafka.client.clientutils$.fetchtopicmetadata(clientutils.scala:59)         @ kafka.client.clientutils$.fetchtopicmetadata(clientutils.scala:94)         @ kafka.consumer.consumerfetchermanager$leaderfinderthread.dowork(consu merfetchermanager.scala:66)         @ kafka.utils.shutdownablethread.run(shutdownablethread.scala:63)

also , want try kafka java api example on windows machine , failed without error msg,my java code :

package com.netease.ecom.data.connect.hdfs;   import com.twitter.bijection.injection; import com.twitter.bijection.avro.genericavrocodecs; import org.apache.avro.schema; import org.apache.avro.generic.genericdata; import org.apache.avro.generic.genericrecord; import org.apache.kafka.clients.producer.kafkaproducer; import org.apache.kafka.clients.producer.producerrecord;  import java.util.properties;  public class simpleavroproducer {      public static final string user_schema = "{"             + "\"type\":\"record\","             + "\"name\":\"myrecord\","             + "\"fields\":["             + "  { \"name\":\"str1\", \"type\":\"string\" },"             + "  { \"name\":\"str2\", \"type\":\"string\" },"             + "  { \"name\":\"int1\", \"type\":\"int\" }"             + "]}";      public static void main(string[] args) throws interruptedexception {         properties props = new properties();         props.put("bootstrap.servers", "192.168.80.128:9092");         props.put("key.serializer", "org.apache.kafka.common.serialization.stringserializer");         props.put("value.serializer", "org.apache.kafka.common.serialization.bytearrayserializer");          schema.parser parser = new schema.parser();         schema schema = parser.parse(user_schema);         injection<genericrecord, byte[]> recordinjection = genericavrocodecs.tobinary(schema);          kafkaproducer<string, byte[]> producer = new kafkaproducer<>(props);          (int = 0; < 1000; i++) {             genericdata.record avrorecord = new genericdata.record(schema);             avrorecord.put("str1", "str 1-" + i);             avrorecord.put("str2", "str 2-" + i);             avrorecord.put("int1", i);              byte[] bytes = recordinjection.apply(avrorecord);              producerrecord<string, byte[]> record = new producerrecord<>("mytopic", bytes);             producer.send(record);              thread.sleep(250);          }          producer.close();     } }

yes , code want send avro data kafka , , failed without errors.

one of kafka server.properties on linux machines :


Comments

Post a Comment

Popular posts from this blog

php - How to add and update images or image url in Volusion using Volusion API -

actually have store importing products store product data insert , update image or image url not insert , update. this xml code name datapro.txt. <products_joined> <productcode>3710_012t</productcode> <vendor_partno>eah5450silent/di/1gd3(lp)</vendor_partno> <productname>test product ta</productname> <hideproduct>n</hideproduct> <stockstatus>20</stockstatus> <lastmodified>1/5/2016 10:25:00 am</lastmodified> <lastmodby>2</lastmodby> <productweight>0.9</productweight> <productprice>100</productprice> <productmanufacturer>asus tek</productmanufacturer> <vendor_price>32.69</vendor_price> <numproductssharingstock>0</numproductssharingstock> <categoryids>107</categoryids> <producturl>http://tebkq.mvlce.servertrust.com/productdetails.asp?productcode=3710_012t</producturl>
Read more

javascript - jQuery UI Splitter/Resizable for unlimited amount of columns -

using jqueryui splitter or resizable functions want create layout allows unlimited amount of columns added , columns need resizable. so fiddle: https://jsfiddle.net/f3glh3mw/ but in fiddle html contains out of nested sets instead of inline. limits possibilities above fiddle can have equal widths 2,4,8,16,32 etc columns. in between shows crooked can see in fiddle. when researching came on question: jquery ui , splitter if @ top answer shows structure like: <div class="wrap"> <div class="resizable resizable1"></div> <div class="resizable resizable2"></div> </div> full fiddle: http://jsfiddle.net/8qztj/86/ which structure want javascript hardcoded 2 resizable items. so here question: how modify last fiddle works amount of .resizable divs. or know of plugin can this. thanks helping! so far found plugin: http://www.bacubacu.com/colresizable/ which says , close functionality want. in
Read more

javascript - IE9 error '$'is not defined -

Image
<!--[if lte ie 9]><html class="lte9"><![endif]--><!--[if gt ie 9]><html><![endif]--> <!--[if !ie]><!--> <html> <!--<![endif]--> blah blah <script src="https://ajax.googleapis.com/ajax/libs/jquery/1.12.1/jquery.min.js"></script> <script src="https://maxcdn.bootstrapcdn.com/bootstrap/3.3.7/js/bootstrap.min.js"></script> <script src="{{ asset('js/mypage.js') }}" type="text/javascript"></script> </body> </html> when load page, ie9 brings error '$' not defined . how can solve error? +++ mypage.js $(function(){ //when load page, //ie9 tag not moving. $(window).load(function() { $('div.mask').hide(); }); // when click , willshow show. //for not ie 9 if (!$('html').hasclass('lte9')) { var = $('ul.about > li > span.activebtn');
Read more