Tag: technology

AI EMAIL: The AI Agent for Parsing Your Emails

I have recently released AI Email, an AI agent based on Chatgpt which is capable of connecting to yorìur GMAIl account and read your emails. You can find the codes on GitHub. The Web interafce is built using Gradio.

How Does It Work?

The Agent can be prompted with authors or topics of interest, and with topics/authors that the user is not interested about. The architecture comprises 4 main elents:
– Emailer class to establish the connection to GMAIL account and read emails. It is also responible for modifying the emails (e.g. set as read and move to trash). For each email message, it returns a dictionary containing the email author, the topic/title, the date of receipt, and the content of the email.
– Author/Topic Checker: a ChatGPT-based LLM that checks whether or not the author and content of the email message are within those of interest for the user.
– Interest Scorer: another LLM that given the list of authors/topics of interest scores the emial message giving a probability score between 0 and 1, with 1 representing the highest interest.
– Summarizer: if the email message is considered relavent by the Interest Scorer, the full email content is passed to the summarizer in order for it to provide the main key points of the email.

The emails that are not considered of interest will be directly sent to trash.

In order for the user to be aware of the behaviour of the agents, the Gradio web app will return a list of both the discarded messages and those considered of interest, with the corresponding summary.

Presenting at IEEE International Conference on Robotics and Automation (ICRA) 2024

Link

It is my great pleasure to announce that I presented the work from my first year in Huawei at ICRA 2024, one of the top international robotics conferences, held in Yokohama.

The work is about a ful pipeline for allowing robots to play table-tennis by employing three different control strategies:
– Model-based
– Pure Reinforcement Learning
– Hybrid Reinforcement Learning

The goal of this work is also to show how to make Reinforcement Learning (RL) algorithms more sample efficient and safe by mixing learning with traditional physics and robot control strategies.

Our custom-made robot for table tennis

Each control strategy needs to identify the hitting parameters defined as a 10 dimesnional vector of 3D racket hitting position, 3D hitting velocity, 3D hitting orientation, hitting time.

The different strategies/agents
The control pipeline

Once the hitting parameters are identified, a motion planner, with safety constraints on robot physicial limitations, is employed to guide the robot and execute the action. The benefit of using the motion planner is two-fold:
– allows inclusion of safety constraints;
– reduces the need for learning-based agents to learn full robot trajectories, making the agents more sample efficient and easier to train.

The Model-based agent pure relies on the ball-physics estimation to predict the ball trajectory, given an estimation of the ball initial state (ball position and velocity). Given the expected future states of the ball, the current robot state, and a target position for the ball to reach after being hit, it is possible to solve Oridnary Differential Equations (ODEs) and an optimization problem to identify the hitting parameters.

The Pure RL approach is a typical neural-network-based RL agent which is trained to output the hitting parameters given the intial ball state estimation.

The Hybrid RL mixes the Model-based and the Pure RL. In fact, given the inital ball state estimation, it predicts the hitting position, hitting time, and ball state at hitting time in the same way as the model-based approach. It then uses RL to learn a correction over the hitting position and time, and the full hitting velocity and orientation.

In both learning-based startegies, the RL setting is singl-step, given the use of the planner that takes the hitting parameters and directly execute the trajectory, without the need of having multiple learning steps per episode.

Overview of the method to identify the hitting parameters with the different agents

Our results show that learning-based startegies are able to compensate for modelling errors and thus outperform the Model-based one.

Most importantly, the use of some model-based features and of the motion planner make thr Hybrid RL the most sample efficient and the most effective agent bothnin simulation and in the real-world.

Our results on simulation and real world