Control ESP32 over Internet using Android App with MIT App Inventor

In this tutorial, we will learn how to build an android app that will control the outputs of ESP32 over WiFi and internet using an Android App. We will control the output GPIO pins of the ESP32 module by toggling the two LEDs connected with the GPIO pins of the module. This android app will be created with MIT App Inventor.

ESP32 Outputs Controller Android App Project Overview

ESP32 Outputs Control using android app Overview

We will create an Arduino IoT app through ESP32 and MIT App Inventor to control the outputs of ESP32.

Firstly, the ESP32 module will connect to the local network. The IP address will be displayed in the serial monitor of Arduino IDE. Inside the android app, the user will first set the IP address to that of the ESP32 module. Click the ‘Set IP Address’ button. A text box and save button will appear. Enter the IP address that you got in the serial monitor and click the Save button. The android app will save the IP address of the ESP32 module.

Next, to control the two LEDs click the respective ON and OFF buttons and the LEDs connected with the respective GPIO pins will turn ON and OFF. The state of the GPIO pin will also be displayed.

A steady internet connection is a must.

We will require the following for our project:

Hardware Required:

  1. ESP32 development board
  2. Two LEDs
  3. Two 220 ohm current limiting resistors
  4. Connecting Wires
  5. Breadboard

Software Required:

  1. Arduino IDE
  2. MIT App Inventor
  3. Android Smartphone with MIT AI2 Companion installed

ESP32 Outputs Control Hardware Setup

ESP32 Outputs Control using android app circuit

In the below schematic, we can see that GPIO4 is connected with the anode pin of the red LED, and the cathode pin is connected with the common ground through the 220-ohm resistor. Likewise, GPIO5 is connected with the anode pin of the green LED, and the cathode pin is connected with the common ground through the 220-ohm resistor. These two GPIO pins will be configured as output pins in the program sketch.

ESP32 Outputs Control using android app circuit schematic
Arduino outputs control connection diagram in fritzing

Setting up Arduino IDE

To follow this project, make sure you have the latest version of Arduino IDE and the ESP32 add-on installed on your Arduino IDE. If you have not installed it before you can follow this tutorial:

Install ESP32 in Arduino IDE ( Windows, Linux, and Mac OS)

Arduino Sketch ESP32 Control Outputs with Android App

Open your Arduino IDE and go to File > New to open a new file. Copy the code given below in that file.

In the following sketch, the ESP32 hosts a web server that allows the user to control GPIO4 and GPIO5 through buttons. These GPIO pins are connected with LEDs and configured as output pins. The web server consists of ON and OFF buttons for each LED. Clicking the button, generates a HTTP request on a URL and the ESP32 responds accordingly by setting the specified output pin HIGH or LOW.

Make sure to replace the network credentials to successfully connect with your local Wi-Fi.

#include <WiFi.h>
#include <WiFiClient.h>
#include <WebServer.h>
#include <ESPmDNS.h>

MDNSResponder mdns;

const char* ssid = "REPLACE_WITH_YOUR_SSID";
const char* password = "REPLACE_WITH_YOUR_PASSWORD";

WebServer server(80);
String webpage = "";

int led1 = 4;
int led2 = 5;

void setup(void) {

  webpage += "<h1>ESP32 Web Server</h1><p>LED at GPIO4 <a href=\"led1ON\"><button>ON</button></a>&nbsp;<a href=\"led1OFF\"><button>OFF</button></a></p>";
  webpage += "<p>LED at GPIO5 <a href=\"led2ON\"><button>ON</button></a>&nbsp;<a href=\"led2OFF\"><button>OFF</button></a></p>";

  pinMode(led1, OUTPUT);
  digitalWrite(led1, LOW);
  pinMode(led2, OUTPUT);
  digitalWrite(led2, LOW);
  delay(1000);
  Serial.begin(115200);
  WiFi.begin(ssid, password);
  Serial.println("");
  while (WiFi.status() != WL_CONNECTED) {
    delay(500);
    Serial.print(".");
  }
  Serial.println("");
  Serial.print("Connected to ");
  Serial.println(ssid);
  Serial.print("IP address: ");
  Serial.println(WiFi.localIP());
   if (mdns.begin("esp")) {
    Serial.println("MDNS responder started");
  }
  server.on("/", []() {
    server.send(200, "text/html", webpage);
  });
  
  server.on("/led1ON", []() {
    server.send(200, "text/html", webpage);
    digitalWrite(led1, HIGH);
    delay(1000);
  });
  
  server.on("/led1OFF", []() {
    server.send(200, "text/html", webpage);
    digitalWrite(led1, LOW);
    delay(1000);
  });
 
  server.on("/led2ON", []() {
    server.send(200, "text/html", webpage);
    digitalWrite(led2, HIGH);
    delay(1000);
  });

  server.on("/led2OFF", []() {
    server.send(200, "text/html", webpage);
    digitalWrite(led2, LOW);
    delay(1000);
  });
  server.begin();
  Serial.println("HTTP server started");
}
void loop(void) {
  server.handleClient();
}

When the user will click the ON/OFF buttons, the web page will redirect to either /led1ON or /led1OFF URL for led1 and /led2ON and /led2OFF URL for led2. Whenever an HTTP GET request is made on the specified URL, the LED connected with the respective GPIO of the ESP32 module will turn ON or OFF accordingly.

Building App with MIT APP Inventor

MIT App Inventor is an incredible web application that helps users build interesting Android applications. It is a block-based programming tool through which users can create fully functional apps for Android devices such as smartphones, tablets e.tc. Often termed beginner-friendly, even people with no prior experience in programming can easily learn how to use this application efficiently. We will use this tool to build our Arduino app as well.

Steps to Create Android App

Go to the following website: and click the ‘Create Apps!’ button.

ESP8266 Google Firebase build your own app MIT Inventor 1

You will be redirected to a new window where you will be asked to sign in with your email account. After signing in you will have to accept the terms as shown below.

ESP8266 Google Firebase build your own app MIT Inventor 2

You will receive a welcome message. You can visit the link to get more information on how to install the inventor on your smartphone. Press ‘Continue’ to proceed. If you want, you can have a look at the tutorials being specified. Otherwise, go to ‘Start a blank project’ to start your app invention.

ESP8266 Google Firebase build your own app MIT Inventor 3

You will be asked to specify your project name. Choose an appropriate name. Click ‘ok.’

MIT APP Inventor ESP32 Outputs Controller Design 1

The Designer opens up. This is where we will design the user interface of our app. We can add text, buttons, images and various other functionalities to our app by dragging and dropping components from the palette to the viewer. Then we will set their attributes through the ‘Properties’ column.

Create Design

Firstly, we will add a heading for our app. Go to Palette > User Interface and head over to ‘Label.’ Now click and drag the label. Drop it on the Viewer side. Now you will be able to view it in the viewer as well as in the components list. Rename it as ‘Heading‘ as shown in the Components section.

Head over to the ‘Properties’ to change the text, font size and colour. The label will automatically update in the viewer. Keep in mind the viewer will show you the final look of your app which will appear on your smartphone.

You can change the properties of the label to incorporate your preferred spacing dimension by changing the width and height of the label.

MIT APP Inventor ESP32 Outputs Controller Design 2

LED 1 Controller Section

Next select HorizontalArrangement from the Layout. Set the Properties as shown below.

MIT APP Inventor ESP32 Outputs Controller Design 3

Go to Palette > User Interface and head over to ‘Label.’ Now click and drag the label. Drop it on the Viewer side. Rename it as ‘led1state‘ as shown in the Components section.

Head over to the ‘Properties’ to change the text, font size and colour.

MIT APP Inventor ESP32 Outputs Controller Design 4

Add another HorizontalArrangement beneath the led1state label. Set the Properties as shown below.

MIT APP Inventor ESP32 Outputs Controller Design 5

Go to User Interface > Button and drag and drop two buttons in the HorizontalArrangement2. Rename the buttons as ‘led1ONbutton‘ and ‘led1OFFbutton‘ respectively. Moreover, change the properties of the buttons as well accordingly. These buttons will be used to control the LED at GPIO4.

The picture below shows the Properties of the led1OFFbutton.

MIT APP Inventor ESP32 Outputs Controller Design 6

To add spacing between the first LED section and the second LED section, we will add a HorizontalArrangement of height 10 pixels beneath HorizontalArrangement2.

MIT APP Inventor ESP32 Outputs Controller Design 7

LED 2 Controller Section

Similarly, we will create the section for the second LED.

Next select HorizontalArrangement from the Layout and place it beneath HorizontalArrangement3. Set the Properties as shown below.

MIT APP Inventor ESP32 Outputs Controller Design 8

Go to Palette > User Interface and head over to ‘Label.’ Now click and drag the label. Drop it on the Viewer side. Rename it as ‘led2state‘ as shown in the Components section.

Head over to the ‘Properties’ to change the text, font size and colour.

MIT APP Inventor ESP32 Outputs Controller Design 9

Add another HorizontalArrangement beneath the led2state label. Set the Properties as shown below.

MIT APP Inventor ESP32 Outputs Controller Design 10

Go to User Interface > Button and drag and drop two buttons in the HorizontalArrangement5. Rename the buttons as ‘led2ONbutton‘ and ‘led2OFFbutton‘ respectively. Moreover, change the properties of the buttons as well accordingly. These buttons will be used to control the LED at GPIO5.

The picture below shows the Properties of the led2OFFbutton.

MIT APP Inventor ESP32 Outputs Controller Design 11

Current IP Address Information

Next add a HorizontalArrangement beneath HorizontalArrangement5. Set its Properties as shown below:

MIT APP Inventor ESP32 Outputs Controller Design 12

Go to Palette > User Interface and head over to ‘Label.’ Now click and drag the label. Drop it inside HorizontalArrangement6. Rename it as ‘ESP32IPlabel‘ as shown in the Components section. The text is set to Current IP: in this.

Head over to the ‘Properties’ to change the text, font size and colour.

MIT APP Inventor ESP32 Outputs Controller Design 13

Now drag another label and drop it beside ESP32IPlabel as shown below. Rename it as ‘ESP32IPinfoLabel.’ The text is empty in this.

MIT APP Inventor ESP32 Outputs Controller Design 14

Save IP Address

Add another HorizontalArrangement beneath HorizontalArrangement6. Rename it as ‘SaveArrangement‘ as shown in the Components section. This arrangement will only be visible when the user will click the ‘Set IP Address’ button.

Set its Properties as shown below. Initially turn the visibility of on because we have to place a textbox and a button inside this arrangement.

MIT APP Inventor ESP32 Outputs Controller Design 15

Go to Palette > User Interface and head over to ‘TextBox.’ Now drag and drop it on the Viewer side, inside the SaveArrangement. The Properties section shows the properties we have set for this arrangement.

This is the textbox where the user will enter the IP address of the ESP32 module.

MIT APP Inventor ESP32 Outputs Controller Design 16

Next add a button beside the textbox as shown below. Rename the button to ‘saveButton‘ and set its properties as shown in the Properties section.

MIT APP Inventor ESP32 Outputs Controller Design 17

Now un tick the visibility of SaveArrangment.

Set IP Address Button

For the ‘Set IP Address’ button, first add a HorizontalArrangement beneath saveArrangement and set its properties as shown.

MIT APP Inventor ESP32 Outputs Controller Design 18

Now place a button inside this horizontal arrangement. Rename it to ‘SetIPbutton‘ and set its properties as shown below:

MIT APP Inventor ESP32 Outputs Controller Design 19

Go to Storage > TinyDB and drag and drop it in the viewer. This is a non-visible component of the app that will store application data such as the IP address of the ESP32 module.

MIT APP Inventor ESP32 Outputs Controller Design 20

Lastly, go to User Interface > WebViewer and drag and drop it in the viewer. Un tick its visibility.

The WebViewer will be used to access the ESP32 outputs control web server to control the LEDs when the ON/OFF buttons will be clicked.

MIT APP Inventor ESP32 Outputs Controller Design 21

Blocks Layout

Now click on the ‘Blocks’ button found at the top of the window. A new editor will open up. Here we will design how our app will respond. We will assemble blocks in the workspace by clicking and dragging them.

MIT APP Inventor ESP32 Outputs Controller Blocks 1

Setting and Saving IP Address

Firstly, assemble the blocks for the SetIPbutton and saveButon as shown below.

When the SetIPbutton is clicked, the SaveArrangement’s visibility is set to true. This means that the textbox and the Save button will now be visible to the user. However, the setIParrangement’s visibility is turned off.

The user will enter the IP address of the ESP32 module in the text box and press the Save button to save it. When the saveButton is clicked, the IP address gets saved in TinyDB with the tag ‘esp_ip.’ The ESP32IPinfoLabel’s text displays the value saved in the tag ‘esp_ip.’ If the tag is not present yet, then an empty string is shown instead. Moreover, the visibility of SaveArrangement is turned off and the visibility of setIParrangement is turned on.

MIT APP Inventor ESP32 Outputs Controller Blocks 2

LED Control

When the led1ONbutton is clicked, the WebViewer accesses the ESP32 outputs control web server by opening the URL set to the IP address of the module joined with /led1ON. The IP address is saved in TinyDB under the tag ‘esp_ip.’ When the user clicks the ON button for led1, the android app opens the URL: http://YOUR_IP_ADDRESS/led1ON. This turns the LED ON.

Next, the state of led1 is also stored in TinyDB under the tag ‘led1state’ with the value ‘LED at GPIO4 is ON.’ The text of led1state is set to the value in the tag led1state saved on TinyDB. If a tag was not present yet, then the text of led1state will be ‘LED at GPIO4.’

MIT APP Inventor ESP32 Outputs Controller Blocks 3

When the led1OFFbutton is clicked, the WebViewer accesses the ESP32 outputs control web server by opening the URL set to the IP address of the module joined with /led1OFF. The IP address is saved in TinyDB under the tag ‘esp_ip.’ When the user clicks the OFF button for led1, the android app opens the URL: http://YOUR_IP_ADDRESS/led1OFF. This turns the LED OFF.

Next, the state of led1 is also stored in TinyDB under the tag ‘led1state’ with the value ‘LED at GPIO4 is OFF.’ The text of led1state is set to the value in the tag led1state saved on TinyDB. If a tag was not present yet, then the text of led1state will be ‘LED at GPIO4.’

MIT APP Inventor ESP32 Outputs Controller Blocks 4

The same logic is used for led2ONbutton and led2OFFbutton as shown below:.

MIT APP Inventor ESP32 Outputs Controller Blocks 5

App Initialization

When the android application is initialized, the text of ESP32IPinfoLabel is set to the value saved in TinyDB in the tag ‘esp_ip’. If no tag is present then an empty string will be displayed. Likewise, the text of led1state is set to the value saved in TinyDB in the tag ‘led1state.’ If no tag is present, the value ‘LED at GPIO4’ is set. Similarly, the text of led2state is set to the value saved in TinyDB in the tag ‘led2state.’ If no tag is present, the value ‘LED at GPIO5’ is set.

MIT APP Inventor ESP32 Outputs Controller Blocks 6

For more information regarding building your app in MIT App Inventor, follow this guide: App Inventor Tutorials.

Setting up App Inventor on Smartphone

Now, as we have built our app in MIT app inventor and have also written its code let’s move ahead and install the App Inventor in our smartphone. Through this, we will be able to access our app on our smartphone from anywhere around the world. Follow the steps closely.

Firstly, go to Play Store and install ‘MIT AI2 Companion.’

ESP8266 Google Firebase build your own app MIT Inventor 23

After you installed the application, open it. You will have to either scan a QR code or type a 6-character code.

ESP8266 Google Firebase build your own app MIT Inventor 20

To access these, go to MIT App Inventor main page where we initially built our app. Go to Build > Android App (.apk). After a few moments your barcode will get generated. You can either download the .apk file or scan the barcode using the MIT App Inventor.

After installing the .apk file on our android phone, we will be able to view the screen which we created.

Now, we will demonstrate the project.

Demonstration

Make sure you choose the correct board and COM port before uploading your code to the board. Go to Tools > Board and select ESP32 Dev Module. Next, go to Tools > Port and select the appropriate port through which your board is connected.

select esp32 board

Click on the upload button to upload the code into the ESP32 development board.

Now, we will upload the files into our ESP32 board. Go to Tools > ESP32 Data Sketch Upload. After a few moments, the files will be uploaded.

SPIFFS sketch data upload

After you have uploaded your code and the files to the ESP32 development board, press its ENABLE button.

ESP32 enable reset button

In your Arduino IDE, open up the serial monitor and you will be able to see the IP address of your ESP32 module after it connects with the local Wi-Fi network.

ESP32 Outputs Control using android app demo 1
Serial Monitor

Open the MIT Companion app on your smartphone. Now press the ‘Set IP Address’ button.

ESP32 Outputs Control using android app demo 2

A textbox and Save button will appear.

ESP32 Outputs Control using android app demo 3

Type the IP address obtained from the serial monitor in the textbox. Then press the Save button.

ESP32 Outputs Control using android app demo 4

The Current IP address is now updated to the one which we just saved.

ESP32 Outputs Control using android app demo 5

Now press the ON/OFF buttons for each LED to control the ESP32 outputs.

ESP32 Outputs Control using android app demo 6
ESP32 Outputs Control using android app demo 7

Video demo:

You may also like to read:

7 thoughts on “Control ESP32 over Internet using Android App with MIT App Inventor”

  1. looking for MIP APK file of this program. you know the download that should have been included. is it hidden somewhere…
    if you send it to me, I will gladly place it on google drive for everyone to use.

    Reply
  2. Hi, I have a question. Is this working with a rgb?
    We copied your code and replaced everything that consists of digitalWrite with ‘ledcsetup’ ; ledcAttachPin ; ledcWrite because we have an rgb.

    and we have expanded the webpage accordingly, because we have an rgb and accordingly have three pins to create our colors.

    We also made three more code blocks for our colors (turquoise, yellow, purple) (structured like the on or off block) to activate the colors by pressing a button on the app, which should actually work because we have the webpage exactly the same like the previous web page from your side, we have only added 3 buttons

    I hope you can relate to my description
    and possibly give me an answer

    Reply
  3. To access via internet, is it possible to enter the IP address as follows: 89. ……. : 600
    either the public IP address of the box (i.e 89. ….) and the external port (i.e 600) after doing a port forwarding in the box to the ESP32?

    Reply
  4. Hello,
    To access from another network, can we make the IP SET with the
    address: (i.e.) 89…… : 600 where 89….. is the public address of the box and 600 the redirected port?

    Reply
  5. Thanks a lot! I’m using it on Arduino Nano Esp32 connected to the phone configured both as Access Point and as Control App and it’s all Ok.

    Reply

Leave a Comment