Skip to content

Post-launch Portenta X8 Redefinition 09-03-23 #897

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 23 commits into from
Mar 9, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
23 commits
Select commit Hold shift + click to select a range
c7c8f86
Martab94/portenta-x8-user-manual (#287)
martab1994 Mar 9, 2023
9fd45f6
[PC-1031] Portenta X8: Create and Upload a Custom Container to the Po…
TaddyHC Mar 9, 2023
e259a98
[PC-1023] Getting Started Tutorial review (#365)
Jorgetrujilloroman Mar 9, 2023
d7cf216
[PC-1027] Portenta X8: Data Exchange Between Python on Linux and an A…
TaddyHC Mar 9, 2023
cd4279a
[PC-1026] Portenta X8: Container Management with Docker & Python on L…
TaddyHC Mar 9, 2023
c30fe7b
[PC-1030] Portenta X8: How To Flash Your Portenta X8 Redefinition (#358)
TaddyHC Mar 9, 2023
8f31601
[PC-1033] Portenta X8: How To Build a Custom Image for Your Portenta …
TaddyHC Mar 9, 2023
bd33863
[PC-####] Portenta X8: Using FoundriesFactory Waves Fleet Management …
TaddyHC Mar 9, 2023
2cc9485
[PC-####] Portenta X8: Uploading Sketches to the M4 Core on Arduino P…
TaddyHC Mar 9, 2023
b0ce7d1
[PC-1035] Grammar fixes (#366)
Jorgetrujilloroman Mar 9, 2023
924dec4
[PC-1034] Portenta X8: Data Logging with MQTT, Node-RED, InfluxDB and…
TaddyHC Mar 9, 2023
7e4b8a3
[PC-1032] Portenta X8: Output WebGL Content on a Screen Redefinition …
TaddyHC Mar 9, 2023
c3dc737
user manual-linter error fix
jcarolinares Mar 9, 2023
aba6fb4
user manual-linter fix
jcarolinares Mar 9, 2023
0fbdf6c
Essentials updated
jcarolinares Mar 9, 2023
f139169
Getting started button updated to user manual
jcarolinares Mar 9, 2023
83052ad
Suggested libraries updated
jcarolinares Mar 9, 2023
63bb1ca
Initial commit - Tutorial content update (Retesting) (#368)
TaddyHC Mar 9, 2023
36ff3f8
[PC-1036] Portenta X8: Multi-Protocol Gateway w/ Max Carrier Tutorial…
TaddyHC Mar 9, 2023
5a82e5b
Tutorials in order. Essentials fix
jcarolinares Mar 9, 2023
a8f52b1
Flashing tutorial PO feedback updated
jcarolinares Mar 9, 2023
c1fc3df
Linter general fix for Portenta X8
TaddyHC Mar 9, 2023
20b4865
Small number fix
jcarolinares Mar 9, 2023
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 3 additions & 9 deletions content/hardware/04.pro/boards/portenta-x8/essentials.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
<EssentialsColumn title="First Steps">
<EssentialElement title="Quickstart Guide" type="getting-started" link="http://docs.arduino.cc/tutorials/portenta-x8/out-of-the-box">
A quick guide to installing your board with the Arduino IDE.
<EssentialElement title="User Manual" type="getting-started" link="http://docs.arduino.cc/tutorials/portenta-x8/user-manual">
A full guide to the basics of the Portenta X8
</EssentialElement>
<EssentialElement link="https://docs.arduino.cc/tutorials/portenta-x8/x8-fundamentals" title="Fundamentals of Portenta X8" type="tutorial">
This article contains information about the fundamental concepts of the Portenta X8.
Expand All @@ -12,13 +12,7 @@

<EssentialsColumn title="Suggested Repositories">
<EssentialElement link="https://github.com/arduino/portenta-containers" title="Portenta X8 containers" type="article">
Some containers examples for Portenta X8, this containers are accessible through your Foundries.io factory.
</EssentialElement>
<EssentialElement link="https://github.com/arduino/lmp-manifest/releases" title="OS Images" type="tutorial">
Releases section from the lmp-manifest repo, lists all the builds also available on the Foundries.io factory.
</EssentialElement>
<EssentialElement link="https://github.com/arduino/lmp-manifest" title="Manifest repository" type="article">
This repository contains a Repo manifest and setup scripts for the Linux microPlatform build system. If you want to modify, extend or port Linux microPlatform to a new hardware platform, this is the manifest repository to use.
Some containers examples for Portenta X8, these containers are accessible through your Foundries.io factory.
</EssentialElement>
</EssentialsColumn>

Expand Down
2 changes: 1 addition & 1 deletion content/hardware/04.pro/boards/portenta-x8/product.md
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
---
title: Portenta X8
url_shop: https://store.arduino.cc/portenta-x8
url_guide: /software/ide-v1/tutorials/getting-started/cores/arduino-mbed_portenta
url_guide: /tutorials/portenta-x8/user-manual
core: arduino:mbed_portenta
certifications: [CE]
productCode: '125'
Expand Down
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
1,148 changes: 1,148 additions & 0 deletions content/hardware/04.pro/boards/portenta-x8/tutorials/01.user-manual/content.md

Large diffs are not rendered by default.

Original file line number Diff line number Diff line change
@@ -0,0 +1,85 @@
---
title: '02. How to Use the Portenta X8 Manager'
difficulty: beginner
tags: [Linux, containers, factories, foundries]
description: 'This article contains information about how to use the Portenta X8 Manager.'
author: Benjamin Dannegård
hardware:
- hardware/04.pro/board/portenta-x8
software:
- fioctl

---

## Overview

The **Portenta** X8 is one of the more advanced boards available from Arduino. And with that comes some new concepts that are not standard for Arduino boards. In this article, we will go through some of the foundations of the Portenta X8 and help you understand how the board works and how you can benefit from its advanced features of this board. You will learn about FoundriesFactory® and how containers on the Portenta X8 work.

## Goals

- Get in-depth information about how the Portenta X8 works
- Learn how containers work

### Required Hardware and Software

- [Portenta X8](https://store.arduino.cc/portenta-x8)
- [fioctl](https://docs.foundries.io/latest/getting-started/install-fioctl/index.html)

## Instructions

If you need help setting up your board, please have a look at the "Getting Started" tutorial. That tutorial will show you how to set up your board with FoundriesFactory and install containers on it.

## Embedded Linux

There are a few things to consider to work in an embedded Linux environment. When approaching Linux-based embedded devices software solutions, you need to provide a base distribution, a mechanism to update it, and some applications that can run on the board. The X8 uses a Linux distribution built with the Yocto Project® as the base platform, with applications that are installed and packaged as confined containers.

A readily-available Linux distribution that packages everything seems most attractive for end users but you need to find a distribution that implements the function that you need. If you need to tweak them, you may end up in a mess of patches on the top of someone else's build system. On the other hand, a generic distribution has some problems since installing software over it may pollute the original system and cause issues when updating the base platform. For example, if you install a new application, the older one no longer works.

In addition, you have to implement lots of things like cybersecurity functions and system updates. Finally, your solution may rely on a too "generic" distribution, with tons of software you don't need. So you may end up removing a lot of software on the target and turning features on and off. Until you break the configuration or need to update the system and begin restarting with a new fresh image, consequently beginning everything from zero again.

### Benefits of Foundries.io

Foundries.io™ created their custom distribution based on Yocto with minimal software installed, by default implementing top-level cybersecurity features like OP-TEE and OSTREE that makes their solution ideal for professional applications.

A custom Over-The-Air (OTA) system update mechanism that is based on a client running on target and a robust cloud server. And they married Docker-compose as a way to deploy a software solution to a target. This is like having an app store for a particular device with the difference that we're not installing an app but a container that may contain a whole distribution or a minimal distribution running only our app or our set of apps.

Additionally, they developed the cloud side as well. You can use what's called FoundriesFactory, a cloud DevSecOps subscription service to build, test, deploy, and maintain secure, updatable IoT and Edge products. It provides a unique id and automatic builds of the base system and containers for this system in one place. Let's now take a look at the Foundries.io Factory page.

### Foundries.io Factory

With the help of the Arduino Cloud integration with *Foundries.io*, you can easily create your Factory right from the Arduino Cloud page. You can set your Factory's platform and name. The Portenta X8 will be the platform in this case.

![Factory page](assets/factory-page.png)

Your Factory page allows you to add members so that you can easily keep track of the members of your team that should have access to the Portenta X8's that are linked to your Factory. You can also set up teams for better management. On the page, you can also find a list of all devices linked to the Factory, along with their name and version of the container currently uploaded to the board. On the containers page, you can find all the different versions of containers uploaded to the Factory.

On the "source" page of your Factory, you can find the four repositories that are used to customize the images. These are:

- **ci-scripts.git**: Scripts that define the platform and container build jobs to the FoundriesFactory continuous integration system.
- **lmp-manifest.git**: The repo manifest for the platform build. It defines which layer versions are included in the platform image. This includes **meta-partner-arduino**, the layer containing Arduino specific customizations (machine definition, device drivers, etc).
- **meta-subscriber-overrides.git**: OE layer that defines what is included in your Factory image. You can add board-specific customizations and overrides. Also, add and remove packages provided in the default Linux microPlatform base.
- **containers.git**: This is where containers and docker-compose apps are defined. It allows us to define what containers to build, and how to orchestrate them on the platform.

While the "targets" page contains the images built by the Continuous integration system each time something commits in the repositories. Committing to **lmp-manifest.git** or **meta-subscriber-overrides.git** repositories will create a platform target while committing to **containers.git** will create a container target. These targets will generate the artifacts for the platforms as specified in the **ci-scripts.git**, including all the required files to program the target in case of platform builds. You can inspect your FoundriesFactory targets on the "targets" page.

## Containers

Containers allow for easy deployment of Linux-based processes, uploaded through git, which can then be tracked on your Factory page. A Linux container is a process isolated from the rest of the system. A container is an image file conformed of the necessary files to run it. This makes the Linux containers portable and consistent throughout development, testing, and production. Making them much quicker to use than development pipelines that rely on replicating traditional testing environments.

*Foundries.io* provides a service that builds images using the Yocto Project and is specifically built around the Linux microPlatform (LmP) distribution they maintain. LmP contains an extensive set of software components needed for IoT applications.

Using [fioctl](https://docs.foundries.io/latest/getting-started/install-fioctl/index.html) allows you to manage your boards through CLI. It makes it easy to upload containers to a board linked to your Factory. When the board is online and connected to the Factory, you can easily push new apps to the board. Using the fioctl command lines, you only need to state the Factory, board, and app.

### Benefits of Containers

For example, if you are developing an application on a laptop and your environment has a specific configuration. Other developers may have slightly different configurations. The application will rely on your configuration and be dependent on specific files, libraries, and dependencies. On the other hand, your business has development and production environments with their configurations and supporting files. You would want to emulate that environment as much as possible locally.

With containers, you can make your app work across environments, pass quality assurance and deploy as fast as possible effortlessly.

The container image contents can be compared to an installation of a Linux distribution complete with RPM packages, configuration files, etc. However, a container image distribution is easier to install than setting a whole new copy of the operating system.

A Linux container is a good solution that requires portability, configurability, and isolation. The idea behind Linux containers is to help develop solutions faster to meet business needs as they arise. In certain scenarios, when real-time data streaming is implemented, containers are a dominant solution to provide the scalability that the application needs. Regardless of the infrastructure on-site, in the cloud, or a mix of both.

## Conclusion

In this tutorial, we have expanded on how the Portenta X8 works with factories and containers. This article also gives a better picture of how to utilize the Portenta X8 to its full potential. Please check out our other tutorials with the Portenta X8 to see how factories and containers are applied in a real-world example.
Original file line number Diff line number Diff line change
@@ -0,0 +1,87 @@
---
title: '03. Uploading Sketches to the M4 Core on Arduino Portenta X8'
description: 'This tutorial explains how to upload Arduino sketches to the M4 core.'
difficulty: intermediate
tags:
- Firmware
- M4
author: 'Pablo Marquínez'
hardware:
- hardware/04.pro/boards/portenta-x8
software:
- ide-v1
- ide-v2
- cli
---

## Overview

In this tutorial, we will go through the process of uploading sketches to the M4 core on the STM32H747XI MCU. For the user, the process is the same as usual but it differs quite a bit in regards to what happens behind the scenes compared to other Arduino boards.

## Goals

- Learn how to use the Arduino IDE to compile and upload a sketch
- Learn how to compile the sketch binaries with the Arduino IDE and upload them manually via ADB

### Required Hardware and Software

- [Portenta X8](https://store.arduino.cc/products/portenta-x8)
- USB-C® cable (either USB-A to USB-C® or USB-C® to USB-C®)
- [Arduino IDE 1.8.10+](https://www.arduino.cc/en/software), [Arduino IDE 2.0+](https://www.arduino.cc/en/software), or [Arduino CLI](https://github.com/arduino/arduino-cli)
- Latest "Arduino Mbed OS Portenta Boards" Core

## Instructions

### Standard Arduino IDE Upload

It is a straightforward process to upload to M4 Core using Arduino IDE. You will have to select the Portenta X8 in the board selector inside the Arduino IDE.

![IDE board selector](assets/x8-board-manager.png)

Create a custom sketch or open one of the example sketches. For example, we will use the blink sketch:

```arduino
void setup(){
pinMode(LED_BUILTIN ,OUTPUT);
}

void loop(){
digitalWrite(LED_BUILTIN , HIGH);
delay(1000);
digitalWrite(LED_BUILTIN , LOW);
delay(1000);
}
```

1. Select the port of your device in the port selector menu
2. Press the Compile and Upload button

The sketch gets compiled into a binary. That binary file is then uploaded to the Linux side of the Portenta X8 via an `adb` SSH connection. The flashing is done on the board itself by active service on Linux. When the sketch has been uploaded successfully, check if the onboard LED is blinking at an interval of one second.

### Upload Manually Using ADB

An alternative to using the standard Arduino IDE upload procedure is by uploading the sketch manually using ADB. First, we need to compile the sketch. In the Arduino IDE, select "Export compiled binary" from the Sketch menu. It will compile the sketch and save the binary file in the sketch folder. Alternatively, you can use the [Arduino CLI](https://arduino.github.io/arduino-cli/) to create an `elf` file.

To upload the firmware, you can use the ADB tool that has been installed as part of the Portenta X8 core. It can be found at `Arduino15\packages\arduino\tools\adb\32.0.0`.

From that directory, you can use the `adb` tool. To upload your compiled sketch, you will need to use the following command:

```
adb push <sketchBinaryPath> /tmp/arduino/m4-user-sketch.elf
```

![ADB upload with a terminal](assets/x8-terminal-ADB-push.png)

## How Does It Work?

The Portenta X8 has a service that waits for a sketch to be uploaded to a folder. If it detects changes, the device will flash the M4 with the uploaded firmware. This works thanks to the following service:

* **monitor-m4-elf-file.service**: this service monitors the directory `/tmp/arduino/m4-user-sketch.elf` and each time it detects a new file, it will proceed to flash the M4 using `openOCD` with the sketch that has been pushed.

## Conclusion

In this tutorial, you have learned how to upload a sketch to the M4 core, by using the standard Arduino IDE procedure and manually with ADB. Now for example you can connect an I<sup>2</sup>C sensor and interact with it.

## Troubleshooting

- If you cannot use the `ADB` tool and the folder `Arduino15\packages\arduino\tools\adb\32.0.0` is empty, remove the Mbed Portenta Core and install it again.
Loading