scala - Manipulating Vectors and Lists in RDDs -


i'm new spark , scala , need following rdd transformation:

input (macaddress,vector(list(ts1,ts2),list(ts2,ts3),list.....)

(c8:3a:bv:b1:3a:e0,vector(list(1472820071, 1472821088), list(1472821088, 1472821429), list(1472821429, 1472824217)))

desided output (macaddress,vector(intvalue,intvalue,...))

(c8:3a:bv:b1:3a:e0,vector(1472821088-1472820071, 1472821429-1472821088,1472824217-1472821429))

in short, have rdd grouped key (macaddress) containing paired lists of values. need transform vector of lists vector containing paired differences computed lists (secondelement-firstelement). number of paired lists in vector variable in rdd (depends macaddress considered)

i don't know transformation have use in case.

thanks

make updates based on datatype

  def flattenrddelements(x:(macaddress,vector[list[int]]) ) : (macaddress,vector[string]) = {     x match {       case (s,y) => (s,y.map(switchlistelements))     }   }    def switchlistelements(x: list[int]):string = x match {     case a::b::nil => b+"-"+a   }    rdd.map(r => flattenrddelements(r))

Comments

Post a Comment

Popular posts from this blog

php - How to add and update images or image url in Volusion using Volusion API -

actually have store importing products store product data insert , update image or image url not insert , update. this xml code name datapro.txt. <products_joined> <productcode>3710_012t</productcode> <vendor_partno>eah5450silent/di/1gd3(lp)</vendor_partno> <productname>test product ta</productname> <hideproduct>n</hideproduct> <stockstatus>20</stockstatus> <lastmodified>1/5/2016 10:25:00 am</lastmodified> <lastmodby>2</lastmodby> <productweight>0.9</productweight> <productprice>100</productprice> <productmanufacturer>asus tek</productmanufacturer> <vendor_price>32.69</vendor_price> <numproductssharingstock>0</numproductssharingstock> <categoryids>107</categoryids> <producturl>http://tebkq.mvlce.servertrust.com/productdetails.asp?productcode=3710_012t</producturl>
Read more

Laravel mail error `Swift_TransportException in StreamBuffer.php line 269: Connection could not be established with host smtp.gmail.com [ #0]` -

i developing website contact-us page guest users can send me email using gmail . anytime try send mail using contact-us form, error swift_transportexception in streambuffer.php line 269: connection not established host smtp.gmail.com [ #0] this mail.php return [ 'driver' => env('mail_driver', 'smtp'), 'host' => env('mail_host', 'smtp.gmail.com'), 'port' => 587, 'from' => ['address' => '', 'name' => ''], 'encryption' => env('mail_encryption', 'tls'), 'username' => env('mail_username'), 'password' => env(mail_password), 'sendmail' => '/usr/sbin/sendmail -bs', 'pretend' => env('mail_pretend', false), ]; this .env mail_driver=smtp mail_host=smtp.gmail.com mail_port=587 mail_username=afecjaped@gmail.com mail_password=********
Read more

C#.NET Oracle.ManagedDataAccess ConfigSchema.xsd -

i'm not able find config schema file (configschema.xsd) of oracle.manageddataaccess itellisense in application configuration file. it supposed in odp.net managed driver files cannot find it... configschema.xsd xml schema file defines configuration section odp.net, managed driver. https://docs.oracle.com/cd/e48297_01/doc/win.121/e41125/installodpmd.htm after having installed oracle developer tools visual studio 2015, seems 2 schema files have been linked app.config file : oracle.dataaccess.common.configuration.section.xsd oracle.manageddataaccess.client.configuration.section.xsd both stored in : c:\program files (x86)\microsoft visual studio 14.0\xml\schemas
Read more