Smart Insight

Today's post will introduce you to the model-free methods of Reinforcement Learning (RL). To have a model of the environment we need to store all the states and actions. To do so, we are limited to the infrastructure limits, that means we need to find another approach when the environment is too big and with too many variables. Therefore, model-free approaches can handle the problems where the world is too big to fit our infrastructures. To better comprehension, the Q-Learning algorithm will be presented and explained. Robot infinite environment - Photo by Dominik Scythe on Unsplash Terminologies Figure 1 - Agent-environment interaction Agent  — The learner and the one that makes actions. The agent's goal is to maximise the cumulative reward across a set of actions and states. Action  — A set of actions which the agent can perform. Different environments allow the agent to perform distinct kinds of actions. The set of all valid actions in a given environment is usu...

Today's post is about a Machine Learning area,  the Reinforcement Learning (RL). This article seeks to summarise the principal types of algorithms used for reinforcement learning. Here we will get an overview of the existing RL methods on an intuitive level. In further posts, we will go into more detail and code examples. Robot - Photo by Photos Hobby on Unsplash As other Artificial Intelligence's approaches, RL is not a new thing. The first studies and developments dating back to the 1850s and further advances on mid-1950s, where Richard Bellman has a huge impact [1]. Now, we are achieving several advances in the area and improving the results year after year. Reinforcement learning is nowadays the most virtuous way to suggest or find the machine’s creativity. Please note, different from human beings, theses algorithms can fetch experience from millions of parallel simulations if they are running on a powerful infrastructure. Terminologies Figure 1 - Agent-environment...

We all know AI is helping us to give several steps ahead in some differentiated sectors. Many scientists point out that AI is leading us to a new industrial revolution. I have the same belief. AI is increasingly improving our world in all aspects. Today's topic is how AI is helping us in the mobility scope. Mobility - VCI, Portugal We are seeing a very significant amount of investments in the automotive industry to apply AI-based algorithms. The self-driving cars are becoming more reliable due to those investments. However, AI is not strictly applied to drive the vehicle. Mobility - VCI, Portugal We see lots of other car features using AI. Some examples are  the emergency brake systems, adaptative cruise control, read traffic signals to identify the allowed velocity, driving monitoring systems to check if the driver is distracted, systems to adjust the vehicle settings such as temperature, mirrors and seat position , and so forth. These features are improving global mobilit...

Being a farmer is not only making plants grow. Apart from all the care applied to the plants, they also need to collect what has been produced. The harvesting of agricultural products is one of the most difficult, and delicate stages in the food production chain. Harvesting strawberries - Photo by Farsai Chaikulngamdee on Unsplash Millions of people are employed in this process. It is a seasoned process what means temporary jobs. These jobs are mostly available in the summer season, where we reach the harvest phase for the majority of the plants. Many farmers dedicate themselves to fruit growth. In this agriculture's field, we have to take care of plants and then pick the fruits. As you may think, this is a hard and repetitive task. Image a farm with several acres of land. G etting all the fruits from the plants can take months and involve lots of people.  Hiring so many people is very expensive for farmers. Besides, people can harvest fruits inappropriately, reducing the fruit...

Artificial Intelligence is proving to be one of the keys to the next human revolution. We can find AI everywhere we go or even do. In these days, almost everything that runs a software uses AI. Thus, we are in contact with AI every day, even if you only use a smartphone.  Food - Photo by Dan Gold on Unsplash It uses AI in a bunch of apps, starting on the camera app. Although we are using AI in so many devices, some people are not aware of it. An example is the use of AI in the Food Industry.  Thereby, I am starting this series of posts to show you where AI is being used and how it is evolving the Food Industry.     Food is a human being need. Do you know how many are we? We are very close to being 8 billion people on earth . Moreover, the projections point to more than 9 billion people in 2050 , and more than 10 billion by 2100 .  We all need food to survive. Agriculture occupies 50% of the habitable land and requires 70% of the water in the world. So...

In my earliest posts, we saw some examples of AI use in our health care systems. Some approaches use AI to develop new tools, other ones use AI to identify new medicines or diseases. Moreover, we also have AI systems to analyse data and predict future events. All of these examples are only the tip of the development line in the AI field.  Doctor - Photo by  Ashkan Forouzani  on  Unsplash To improve our way of life many companies and universities are investing millions. Their goal is to bring us the best AI systems. Indeed, some of them still have some output errors. Consequently, the companies are studying why they face those errors and how they can overcome these problems. I believe that in the next couple of years we will start to see the health care systems revolution, mostly due to AI integration and evolution. The first successful AI projects are now available, so its a matter of time until AI positively improve our health systems.  COVID-19 pr...

After learning about some examples of AI applications in the diagnosis phase and in the development of new tools, let's talk about AI and predicting the future.  Everyone dreams of the ability to predict the future. Such an ability could avoid some problems in our daily life. Data Analysis -  Photo by  Carlos Muza  on  Unsplash Could AI leverage us to reach that desired dream? We all heard about predicting AI algorithms applied especially on our economy. However, the big question here is: Can we use AI to predict diseases, new diseases, or even pandemics? Do we already have this kind of algorithms? Google's Scientists developed an AI system capable of analyzing scans of the back of an eye so it can predict data about the patients [1]. Some of the predicted data is related to the person's age, blood pressure, or if he/she smokes. Such indicators are directly related to cardiac events , like heart attacks. Thus, using this method, we do not need blood test...

Artificial Intelligence can be used to innovate our health system  even more . It can be done either in the diagnosis phase, the medicine production, vaccine discovery, prediction of pandemics, and so on. We already discussed some examples in the diagnosis phase, now let's talk about using AI to bring new ways of doing your tasks. Pills - Photo by  freestocks  on  Unsplash Developing a new medicine is difficult. It requires many hours of work and investing tons of money. Different steps are required to bring a new medicine into the market. Still, some of the new drugs prove to be a failure before even reaching the final stage. There is where AI can become such a powerful tool for saving money and focusing the research through the best type of drugs . All started to be a real thing when we had the first robot founding some new gene functions in the yeast [1]. Another robot also discovered that a drug called triclosan, used in our toothpaste, can be used to f...