Kafka produce or consume msg failed from windows clients to remote Linux servers -


i both download kafka_2.10-0.10.0.1 windows , linux machine(i have cluster has 3 linux machines ,192.168.80.128/129/130).so , use windows machine kafka client , linux machines kafka servers. try produce msg windows remote kafka server, command , response below:

f:\kafka_2.10-0.10.0.1\kafka_2.10-0.10.0.1\bin\windows>kafka-console-pr oducer.bat --broker-list 192.168.80.128:9092 --topic wuchang dadfasdf asdfasf [2016-11-08 22:41:30,311] error error when sending message topic wuchang  key: null, value: 8 bytes error: (org.apache.kafka.clients.producer.intern als.errorloggingcallback) org.apache.kafka.common.errors.timeoutexception: batch containing 2 record(s) ex pired due timeout while requesting metadata brokers wuchang-0 [2016-11-08 22:41:30,313] error error when sending message topic wuchang  key: null, value: 7 bytes error: (org.apache.kafka.clients.producer.intern als.errorloggingcallback) org.apache.kafka.common.errors.timeoutexception: batch containing 2 record(s) ex pired due timeout while requesting metadata brokers wuchang-0

i sure kafka cluster ok because run produce , consume command directly on linux server successfully.

ofcource , comsume msg remote kafka server failed:

f:\kafka_2.10-0.10.0.1\kafka_2.10-0.10.0.1\bin\windows>kafka-console-co nsumer.bat --bootstrap-server 192.168.80.128:9092 --topic wuchang --from-beginni ng --zookeeper 192.168.80.128:2181 [2016-11-08 22:56:43,486] warn fetching topic metadata correlation id 0  topics [set(wuchang)] broker [brokerendpoint(1,vm02,9092)] failed (kafka.c lient.clientutils$) java.nio.channels.closedchannelexception         @ kafka.network.blockingchannel.send(blockingchannel.scala:110)         @ kafka.producer.syncproducer.liftedtree1$1(syncproducer.scala:80)         @ kafka.producer.syncproducer.kafka$producer$syncproducer$$dosend(syncp roducer.scala:79)         @ kafka.producer.syncproducer.send(syncproducer.scala:124)         @ kafka.client.clientutils$.fetchtopicmetadata(clientutils.scala:59)         @ kafka.client.clientutils$.fetchtopicmetadata(clientutils.scala:94)         @ kafka.consumer.consumerfetchermanager$leaderfinderthread.dowork(consu merfetchermanager.scala:66)         @ kafka.utils.shutdownablethread.run(shutdownablethread.scala:63)

also , want try kafka java api example on windows machine , failed without error msg,my java code :

package com.netease.ecom.data.connect.hdfs;   import com.twitter.bijection.injection; import com.twitter.bijection.avro.genericavrocodecs; import org.apache.avro.schema; import org.apache.avro.generic.genericdata; import org.apache.avro.generic.genericrecord; import org.apache.kafka.clients.producer.kafkaproducer; import org.apache.kafka.clients.producer.producerrecord;  import java.util.properties;  public class simpleavroproducer {      public static final string user_schema = "{"             + "\"type\":\"record\","             + "\"name\":\"myrecord\","             + "\"fields\":["             + "  { \"name\":\"str1\", \"type\":\"string\" },"             + "  { \"name\":\"str2\", \"type\":\"string\" },"             + "  { \"name\":\"int1\", \"type\":\"int\" }"             + "]}";      public static void main(string[] args) throws interruptedexception {         properties props = new properties();         props.put("bootstrap.servers", "192.168.80.128:9092");         props.put("key.serializer", "org.apache.kafka.common.serialization.stringserializer");         props.put("value.serializer", "org.apache.kafka.common.serialization.bytearrayserializer");          schema.parser parser = new schema.parser();         schema schema = parser.parse(user_schema);         injection<genericrecord, byte[]> recordinjection = genericavrocodecs.tobinary(schema);          kafkaproducer<string, byte[]> producer = new kafkaproducer<>(props);          (int = 0; < 1000; i++) {             genericdata.record avrorecord = new genericdata.record(schema);             avrorecord.put("str1", "str 1-" + i);             avrorecord.put("str2", "str 2-" + i);             avrorecord.put("int1", i);              byte[] bytes = recordinjection.apply(avrorecord);              producerrecord<string, byte[]> record = new producerrecord<>("mytopic", bytes);             producer.send(record);              thread.sleep(250);          }          producer.close();     } }

yes , code want send avro data kafka , , failed without errors.

one of kafka server.properties on linux machines :


Comments

Post a Comment

Popular posts from this blog

php - How to add and update images or image url in Volusion using Volusion API -

actually have store importing products store product data insert , update image or image url not insert , update. this xml code name datapro.txt. <products_joined> <productcode>3710_012t</productcode> <vendor_partno>eah5450silent/di/1gd3(lp)</vendor_partno> <productname>test product ta</productname> <hideproduct>n</hideproduct> <stockstatus>20</stockstatus> <lastmodified>1/5/2016 10:25:00 am</lastmodified> <lastmodby>2</lastmodby> <productweight>0.9</productweight> <productprice>100</productprice> <productmanufacturer>asus tek</productmanufacturer> <vendor_price>32.69</vendor_price> <numproductssharingstock>0</numproductssharingstock> <categoryids>107</categoryids> <producturl>http://tebkq.mvlce.servertrust.com/productdetails.asp?productcode=3710_012t</producturl...
Read more

Laravel mail error `Swift_TransportException in StreamBuffer.php line 269: Connection could not be established with host smtp.gmail.com [ #0]` -

i developing website contact-us page guest users can send me email using gmail . anytime try send mail using contact-us form, error swift_transportexception in streambuffer.php line 269: connection not established host smtp.gmail.com [ #0] this mail.php return [ 'driver' => env('mail_driver', 'smtp'), 'host' => env('mail_host', 'smtp.gmail.com'), 'port' => 587, 'from' => ['address' => '', 'name' => ''], 'encryption' => env('mail_encryption', 'tls'), 'username' => env('mail_username'), 'password' => env(mail_password), 'sendmail' => '/usr/sbin/sendmail -bs', 'pretend' => env('mail_pretend', false), ]; this .env mail_driver=smtp mail_host=smtp.gmail.com mail_port=587 mail_username=afecjaped@gmail.com mail_password=********...
Read more

c# SetCompatibleTextRenderingDefault must be called before the first -

i tried search exception couldn't find solution on case i'am using code below invoke .net application : assembly assem = assembly.load(data); methodinfo method = assem.entrypoint; var o = activator.createinstance(method.declaringtype); method.invoke(o, null); the application invoked has form , in entrypoint of application : [stathread] static void main() { application.enablevisualstyles(); application.setcompatibletextrenderingdefault(false); //exception application.run(new form1()); } setcompatibletextrenderingdefault must called before first iwin32window object created in application. edit : assembly = assembly.load(data); methodinfo method = a.gettype().getmethod("start"); var o = activator.createinstance(method.declaringtype); method.invoke(o, null); you should create new method skips initialization...
Read more