x

HIT incubated Ruoyu Technology t"‌o launch robot brain, realizing gr₩♣oup intelligence driven by multγ‍≥λimodal large models

Release time: 2024-05-28

In recent years, the rapid devel​♥≤↔opment of AI big model technoσ★logy has achieved results co>☆mparable to or even exceeding those ε'±of humans in some nichα§€e fields. It has also prλ∑ omoted the development of embodied inte•£✔lligence technology and continued to •♣★♠enable traditional physical entiti≠σ∏‌es (such as industrial robotic arms, h♣©≈umanoid robots, etc.) to achi• ★eve complex interactions with the pβ☆✔✘hysical world.

However, there is a large industry g γap between the general ♦≠AI big model and the embodied intell≠±igence industry brain. The core o€γf this is that the general AI big mode™←¶≠l has weak domain adapt•↑♦>ability to embodied inte♥"lligence scenarios. Therefore, it is↑∞€∑ necessary to develop its own dedi♣←↕cated brain in the field δ∑↕±of robotics.

Domestic robot brain startups are bδ‌ooming. Ruoyu Technology , located ×∞in Shenzhen and established wi♣ th the support of Harbin Instit₽→ute of Technology (Shenzhen), is one of the few companies in ₽₹♠≠China that focuses on the research an✘☆±"d development of multi-mo"×βdal large-model robot brai☆‍×ns.

Recently, Ruoyu Tech←&nology launched the Ruoyu · Jiutian R≠§obot Brain, which has realized groε₩$up intelligence driven by‌∞  a multi-modal large model, an≠γd verified the technical so§≠lution through an unma♥‌nned kitchen environment, driving multiple intelligent aβ✘→gents to cook in an unmaσ±‌₹nned kitchen. Through human natural language interact>₽ion with multiple ro↑β £bots, the entire process from orderingΩ↓•♣ to serving is completed, and t>απhe long sequence of ">←cooking" tasks is plan©Ωned autonomously. Differentσ© from the common embodied inte★©'lligence technology o¥∏n the market, the Ruoy×♥u · Jiutian Robot Brain  " ↕can realize functions such <&σas human intention understanding,≥✔σ​ high-frequency human$​​-computer interaction, and complex ta€σ¥sk planning.

圖片

Natural language intera←→ction (zero learning cost "©for users)

圖片

Long sequence missio₽¶δn planning (quickly generate complex ​₹mission plans)

When a human requests "a servin‌✘¥¥g of stir-fried lettuce", theε★γγ robot can independently und¶×erstand human intentions and plan task ¥δs, breaking them down into mu↔ ≤ ltiple steps such as "pick up vegetables in thδ ♠e food area", "wei≤★ gh in the preparation ar←£ea", "cook in t±‌he production area&quo&‌t;, and "serve in the consumption ">↑€area" .

the Ruoyu Jiutian robot has a certain ab∏ ility to generalize . For example, when training &λ↑∞the model, it was only told to add♠γ garlic, but not to add chi← li peppers. But if the robot is asked ™§ to add chili peppers later, •★it can automatically understand tha←‍t garlic and chili peppers are™<• both ingredients, and know to replac♠≈e garlic with chili pe£δppers.

Ruoyu Jiutian Robot Brain is the group i§€ntelligence driven by a mul×&±♦timodal large model, which gives multip$✔le intelligent agents th>‍ e ability to autonomously divide lα ‍∑abor and collaborate.

In simple terms, it is "one brain, multipleλ× ≈ bodies". Multiple robots (including robot"‍✘ic arms and AGVs) are centrally cont™←•☆rolled by Ruoyu Jiutian Brain. Multiple robots work togeα€≠<ther to efficiently perform complex ←>tasks, and there are complex dependen©​ ¶cies between these different tasλ∏​ks.

For example, two robots are cookinδ₩£g while another robot is picking up®<£→ bowls and chopsticks. If the coo£§×♥king time is extended dγ&÷ ue to a temporary change in th∑λ♥♠e cooking process, the other rob¥£ot can decide to pick up th¶∑e next ingredient aft"↓≠er picking up the bo§₽±wls and chopsticks, instead of waiti ∑ng, thereby improving efficiency≥  ¥. The robot brain will aπ♥αutonomously plan the ta ‍$sk logic so that all robots w♥✘ill not stop as much as possible whil↑'≥e ensuring the safety of col££™♠laboration. "This is difficult to'≈×σ achieve with traditioπ$≠Ωnal rule-based teachi$↑ Ωng methods," said↔>‌↔ Deng Yuping, Chief P×βroduct Officer of Ruoyu Technology.


圖片

Swarm intelligence driven by larg ↔<δe models (giving multiple agγφents the ability to autonomou •∑sly divide work and collabor∞™ ate)

The Ruoyu Jiutian Robot Brain has also ma✘×de technical optimizations i•£₹n the cerebellum that ± controls the execution  ★level of the robot in orde<→→r to further promote its impγ ±αlementation. For example, ♦ £in response to the challenge of difficuγ✔♣lt perception of diverse environments,↔™ Ruoyu Technology has developed a large<™-model 3D affordance pe≈☆‌rception technology that can ≈↓≥Ωperceive the functio¶♥÷>nal affordance area of objects and ca♠'n grasp a variety of obje$€♣±cts without registratio≈↓€n, complex light, or stacking.

圖片

3D intelligent recognition and ♣ capture (registration-free, ≤‍stacking, and resistance to complex l♥✘ight)

In response to the chall£ '®enges of difficult execution of complex"★ actions such as "robots pouri←¥ng garlic from ingred™§✘≥ient boxes" and &q©&uot;using shovels to pour↓→↔ finished dishes from pα₽÷βots", Ruoyu Technology propo¶₽∞£sed diffusion model-driven imitati•&on learning technology to achieve accurate execution of comp≤γ•lex skills and action↕®↓s. At the same time, combin××€±ed with multi-modal large model-drive©ε™↑n robot multi-arm collabora♥㥕tion technology, the collabo☆φ​rative ability and execution efficie•§×δncy of the target task have beenλ→ greatly improved.

圖片

Complex action execution driv♥©en by diffusion mode↓•l (no need for on-sit↔ e teaching, precise&nε±δbsp;execution)

圖片

Large model-driven dual-arm co≤↔←↔llaboration (greatly im₽ proving collaboration capabil€<¥≠ities and efficiency)

At present, international embodied §'intelligent brain achievements includeγ>•≥ PaLM-E of Google'↔€Ω;s artificial intelligence team, RT-1©‌♠/RT-2/RT-X of Google DeepMind t±Ω>eam, Physical Intelligen←≤€ ce invested by Open AI, and so on.>↔

Shenzhen Ruoyu Technology Co.,•∑ Ltd. was established in 2023 and was i↑±™'ncubated by the team of Harbin Ins✘→σσtitute of Technology (Shenzhen) Instit≥¶ute of Computing and Intell‍>αεigence. The core team Ω$£brings together more than doz↓¥Ωens of national leading ta$¶♠lents and young talents in the currentλ€ fields of multimedia, NLP an♦αd embodied intelligence, cover↕∑ing all directions of large model res↕δearch and development, ↓®∑ including embodied intelligence, co​™ ​ntent understanding, content generation₹δ₹ and large model lightwe≤≈αight and compression.

Ruoyu Technology completed an angσ¥el round of financin✘γ£↔g of over 50 million y↔'uan in March this year. The in£≈"'vestors in this round incluβγ>☆ded Dongfang Precision and Kinzon Capi↓σtal, and Yuanhe Capital±↓ served as the exclusive finan‍ λcing advisor. The co₹✔←mpany said that the funds will be maiβ↔nly used for product research and dev'<±elopment, business expansion andφ±'$ team building.

It is reported that Ruoyu Technolo©≥≈Ωgy has reached a cooperation with D≥&ongfang Precision Group. Dongfα<ang Precision Group has now become♥®✘δ the international leade€​r in corrugated paper packaging inσλtelligent equipment, the domestic l' ☆αeader in digital printing‌€®& equipment, and the leading co™φΩ♠mpany in water power equip♠Ω✔ment. It continues to expa∞✘nd new business in the smart σλ£factory industry and σ♠¥ realize the upgrade of γ<α↑intelligent equipmen ≈™≈t manufacturers to smart facπ₽Ω♠tory overall solution service provid&£σπers. It can provide Ruoyu ≥δ♥Technology with rich industrial$★≈ scene data and downstream corpora↔★¶te customers, and Ruoyu $€Technology's robot brai✔₩♦n can empower Dongfang Precisi®‍♦on Group's core intΩ•♠elligent equipment and improve the©  intelligence level of Dongfang Precis<σ←ion's core products.

Dr. Sun Teng, co-founδ♠λder and CEO of Ruoyu Technology,↕>± said: " The technological breakthrou∞ ghs of Ruoyu Technology' €β;s Jiutian robot brain ¶β•☆and robot cerebellum c₩↕an be further applied to co‍≈✘mplex processes in th¶≈£γe industrial field, such as welding, grinding, and dispe≠‌•∞nsing, sorting and m σ≈ixed palletizing in the logistics fie $<δld, unmanned retail, unmanned pharmac₩‌¥ies, and three-dimens¶∑↓§ional cleaning in the commerciα♣al field. In the future, it can be furt"₩ her extended to the consumer field. A∏<φ≈t present, Ruoyu Technology ha₩δs also worked with industry partnσ₩↑✘ers in certain special fie÷↕∑lds to create more int✘★>elligent robots for specific scenario∞✘s, freeing people from d☆λangerous, heavy, and repetitive labor✘₹, improving the quality and ≤✔δπefficiency of the industry, and creatinα✘"g new quality product¶←αivity."





Contact Us

business@ruoyutech.com

Address:Room 903, Bl® ock A, Zhongguan Times Square, Nanshan $ ≠District, Shenzhen, Guan↑<gdong, China

Copyright@ Ruoyu Technology Powered by EyouCms   京ICP證000000号  粵公網安備44030902003927号