no OTA example works for AI Thinker ESP32-CAM (wrong partition table?) #6114

beta-tester · 2022-01-08T23:30:43Z

Board

AI Thinker ESP32-CAM

Device Description

USB-to-Serial adapter. 3.3V logic level, 5V power.

Hardware Configuration

WLAN router,
Raspberry Pi as http server.

Version

latest master
(2.0.2)

IDE Name

Arduino IDE 1.8.19 (Linux 64 bits)
Arduino IDE 1.8.19 (Linux ARM 32 bits)

Operating System

Ubuntu 21.10 (64bit)
RasPi OS Buster / Bullseye (32bit)

Description

i can successfully update my ESP32 Dev Modules via OTA by using the example sketches: WebUpdate.ino and httpUpdate.ino.

but when i switch the Arduino IDE to AI Thinker ESP32-CAM and compile the sketches for that and flash it to the Ai Thinker ESP32-CAM (compatible) modules and try to update the device via OTA it crashes. with

abort() was called at PC ...

ELF file SHA256: 0000000000000000

Backtrace: ...

Sketch

/libraries/ArduinoOTA/examples/OTAWebUpdater/OTAWebUpdater.ino
/libraries/HTTPUpdate/examples/httpUpdate/httpUpdate.ino
/libraries/WebServer/examples/WebUpdate/WebUpdate.ino

Debug Message

abort() was called at PC ...

ELF file SHA256: 0000000000000000

Backtrace: ...

Other Steps to Reproduce

No response

I have checked existing issues, online documentation and the Troubleshooting Guide

I confirm I have checked existing issues, online documentation and Troubleshooting guide.

The text was updated successfully, but these errors were encountered:

beta-tester · 2022-01-09T00:00:08Z

i think the partition table settings for that AI Thinker ESP32-CAM board in arduino esp32 is not compatible for OTA skeches.
i read something about it.

WORKAROUND:
i got OTA working for AI Thinker ESP32-CAM boards by editing the file:
~/.arduino15/packages/esp32/hardware/esp32/2.0.2/boards.txt

i duplicated the block of esp32cam
and renamed esp32cam to esp32camota of the duplicated block
then i changed esp32camota.name=AI Thinker ESP32-CAM to esp32camota.name=AI Thinker ESP32-CAM (for OTA)
then i changed esp32camota.build.partitions=huge_app to esp32camota.build.partitions=default.

after a new start of Arduino IDE i now have an additional entry in the ESP boards list with the name: "AI Thinker ESP32-CAM (for OTA)".
by using this board settings, compiling and flashing the OTA example skeched to the AI Thinker ESP32-CAM this device is now able to successfully update over the air.

i don't know if it is the right way, if default is the right and optimal setting for OTA in the AI Thinker ESP32-CAM modules but it works as far as i can see.
my suggestion is to add an official kind of permanent fix to the repository.

Hieromon · 2022-02-03T02:32:52Z

The AI-Thinker ESP32-CAM board definition described in the boards.txt only has a partition schema with no reservation for OTA space as a huge_app.csv. A modification to boards.txt to reserve the OTA area is to list the partition schema choices with menu.PartitionScheme in the esp32cam section.

esp32cam.name=AI Thinker ESP32-CAM

esp32cam.upload.tool=esptool_py
esp32cam.upload.maximum_size=3145728
esp32cam.upload.maximum_data_size=327680
esp32cam.upload.flags=
esp32cam.upload.extra_flags=
esp32cam.upload.speed=460800

esp32cam.serial.disableDTR=true
esp32cam.serial.disableRTS=true

esp32cam.build.tarch=xtensa
esp32cam.build.bootloader_addr=0x1000
esp32cam.build.target=esp32
esp32cam.build.mcu=esp32
esp32cam.build.core=esp32
esp32cam.build.variant=esp32
esp32cam.build.board=ESP32_DEV
esp32cam.build.flash_size=4MB
esp32cam.build.partitions=default
esp32cam.build.defines=-DBOARD_HAS_PSRAM -mfix-esp32-psram-cache-issue -mfix-esp32-psram-cache-strategy=memw
esp32cam.build.extra_libs=
esp32cam.build.code_debug=0

esp32cam.menu.PartitionScheme.default=Default(3MB No OTA/1MB SPIFFS)
esp32cam.menu.PartitionScheme.default.build.partitions=huge_app
esp32cam.menu.PartitionScheme.default.upload.maximum_size=3145728
esp32cam.menu.PartitionScheme.no_ota=No OTA (2MB APP/2MB SPIFFS)
esp32cam.menu.PartitionScheme.no_ota.build.partitions=no_ota
esp32cam.menu.PartitionScheme.no_ota.upload.maximum_size=2097152
esp32cam.menu.PartitionScheme.min_spiffs=Minimal SPIFFS (1.9MB APP with OTA/190KB SPIFFS)
esp32cam.menu.PartitionScheme.min_spiffs.build.partitions=min_spiffs
esp32cam.menu.PartitionScheme.min_spiffs.upload.maximum_size=1966080

esp32cam.menu.CPUFreq.240=240MHz (WiFi/BT)
esp32cam.menu.CPUFreq.240.build.f_cpu=240000000L
esp32cam.menu.CPUFreq.160=160MHz (WiFi/BT)
esp32cam.menu.CPUFreq.160.build.f_cpu=160000000L
esp32cam.menu.CPUFreq.80=80MHz (WiFi/BT)
esp32cam.menu.CPUFreq.80.build.f_cpu=80000000L
esp32cam.menu.CPUFreq.40=40MHz (40MHz XTAL)
esp32cam.menu.CPUFreq.40.build.f_cpu=40000000L
esp32cam.menu.CPUFreq.26=26MHz (26MHz XTAL)
esp32cam.menu.CPUFreq.26.build.f_cpu=26000000L
esp32cam.menu.CPUFreq.20=20MHz (40MHz XTAL)
esp32cam.menu.CPUFreq.20.build.f_cpu=20000000L
esp32cam.menu.CPUFreq.13=13MHz (26MHz XTAL)
esp32cam.menu.CPUFreq.13.build.f_cpu=13000000L
esp32cam.menu.CPUFreq.10=10MHz (40MHz XTAL)
esp32cam.menu.CPUFreq.10.build.f_cpu=10000000L

esp32cam.menu.FlashMode.qio=QIO
esp32cam.menu.FlashMode.qio.build.flash_mode=dio
esp32cam.menu.FlashMode.qio.build.boot=qio
esp32cam.menu.FlashMode.dio=DIO
esp32cam.menu.FlashMode.dio.build.flash_mode=dio
esp32cam.menu.FlashMode.dio.build.boot=dio
esp32cam.menu.FlashMode.qout=QOUT
esp32cam.menu.FlashMode.qout.build.flash_mode=dout
esp32cam.menu.FlashMode.qout.build.boot=qout
esp32cam.menu.FlashMode.dout=DOUT
esp32cam.menu.FlashMode.dout.build.flash_mode=dout
esp32cam.menu.FlashMode.dout.build.boot=dout

esp32cam.menu.FlashFreq.80=80MHz
esp32cam.menu.FlashFreq.80.build.flash_freq=80m
esp32cam.menu.FlashFreq.40=40MHz
esp32cam.menu.FlashFreq.40.build.flash_freq=40m

With this fix, the Tool menu in the Arduino IDE will show the partition table available for the OTA.

ChristopheLaurent · 2022-02-18T19:20:37Z

Using PlatformIO, I managed to do OTA on this board by specifying the right partition.

In platformio.ini:

[env:esp32cam]
platform = espressif32
board = esp32cam
framework = arduino
build_type = debug
monitor_filters = esp32_exception_decoder
board_build.partitions = partitions_custom.csv

In partitions_custom.csv:

# Name,   Type, SubType, Offset,  Size, Flags
nvs,      data, nvs,     0x9000,  0x5000,
otadata,  data, ota,     0xe000,  0x2000,
app0,     app,  ota_0,   0x10000, 0x180000,
app1,     app,  ota_1,   0x190000,0x180000,
spiffs,   data, spiffs,  0x310000,0xF0000,

easytarget · 2022-03-10T18:42:38Z

The AI-THINKER board definition in the IDE is most definitely not OTA compatible and offers no partition scheme selection.
You can work around this by selecting the vanilla dev board and choosing a OTA compatible partition scheme. Don't forget to also enable PSRam.

I have an OTA compatible fork of the standard webcam sketch and have documented the relevant settings here: https://github.com/easytarget/esp32-cam-webserver#programming

VojtechBartoska · 2022-04-11T11:42:51Z

Hello, can you please retest this on v2.0.3-rc1?

VojtechBartoska · 2022-05-03T13:53:47Z

any news?

beta-tester · 2022-05-03T17:41:32Z

Hello, can you please retest this on v2.0.3-rc1?

sorry for my late response, i couldn't try it yet.
how can i swap from regular release to release candidate v2.0.3-rc1?

VojtechBartoska · 2022-05-04T08:19:16Z

Take a look on installing guide please.

https://docs.espressif.com/projects/arduino-esp32/en/latest/installing.html

easytarget · 2022-05-07T13:13:07Z

Ok; this appears to be resolved, in the boards manager for 2.0.3 release the AI-Thinker ESP32-CAM entry now exposes the partition scheme, you can select an OTA compatible partition scheme, and everything works as expected.

I tested this by selecting the board + ota partition (minimal spiffs) used for my sketch and flashing the 'BasicOTA' example over it (over the air), then re-flashing my sketch back over the example (again, over the air).

I also checked the boards definition in the 2.0.3 package's boards.txt, and verified that it has psram enabled.

This is easy enough to document for my projects users, I consider it closed, thankyou.

readnotify · 2023-05-28T04:13:35Z

Here's the only working OTA for this board I've seen: https://github.com/wjsanek/wjsanek

They're cleverly using the unused OTA partition as the SPIFFS for the camera data, which is how and why it can work.

GnomiBerlin · 2023-06-18T15:07:11Z

Also if using the right partition for OTA usage I found out, that the ESP32-CAM board is rebooting on firmware update, if the frame buffer for big pictures is configured like: config.fb_count = 2;
if config.fb_count = 1; then all web and Arduino OTA firmware updates are working with PSRAM usage.
Can someone explain, why the frame buffer allocation impacts the OTA function?

beta-tester · 2023-06-19T09:15:29Z

... if config.fb_count = 1; then all web and Arduino OTA firmware updates are working with PSRAM usage.
Can someone explain, why the frame buffer allocation impacts the OTA function?

what is your config.fb_location setting, CAMERA_FB_IN_PSRAM or CAMERA_FB_IN_DRAM ?

or it may have someting to do with the restrictions

me-no-dev · 2023-06-19T10:04:01Z

when fb_count is more than 1 and you have set CAMERA_GRAB_LATEST the DMA+ISR of the camera are constantly triggered to get the latest frame, so that could cause some issues with caching and PSRAM usage. Generally not expected, but ESP32 does have some workarounds for issues with PSRAM. S3 should work OK regardless

beta-tester · 2023-06-19T10:56:29Z

@me-no-dev , i just stumbled over this condition in the esp32-camera/driver/cam_hal.c code:

esp_err_t cam_config(const camera_config_t *config, framesize_t frame_size, uint16_t sensor_pid)
{
    ...
#if CONFIG_IDF_TARGET_ESP32
    cam_obj->psram_mode = false;
#else
    cam_obj->psram_mode = (config->xclk_freq_hz == 16000000);
#endif
    ...

does it mean, when the target is ESP32, psram is not used at all, or is that something totally different?

GnomiBerlin · 2023-06-19T12:35:41Z

@beta-tester: I used the basis from the ESP32 Camera example: CameraWebServer.
There we have:

.....
config.fb_location = CAMERA_FB_IN_PSRAM;
  config.jpeg_quality = 12;
  config.fb_count = 1;
  
  // if PSRAM IC present, init with UXGA resolution and higher JPEG quality
  //                      for larger pre-allocated frame buffer.
  if(config.pixel_format == PIXFORMAT_JPEG){
    if(psramFound()){  
      config.jpeg_quality = 10;
      config.fb_count = 1; //2
      config.grab_mode = CAMERA_GRAB_LATEST;
    } else {
      // Limit the frame size when PSRAM is not available
      config.frame_size = FRAMESIZE_SVGA;
      config.fb_location = CAMERA_FB_IN_DRAM;
    }

As the ESP32-CAM uses PSRAM psramFound() should be true and so

config.fb_location = CAMERA_FB_IN_PSRAM;
config.fb_count = 1; //not 2 for OTA ?
      config.grab_mode = CAMERA_GRAB_LATEST;

is the used cobfiguration.
As I tested with no PSRAM usage (either in IDE disabled or fixing this this "if psramFound()" I think the answer to your second comment is "no". In this case all OTA variants were working, independent from the frame buffer setting. (of course with an OTA usable partition scheme)

@me-no-dev: ESP32-CAM only used ESP32, not S3. And if DMA+ISR is always triggered in case of buffer frames >1 I do not understand, why PSRAM is disturbing the OTA, which in my understanding is happening in the DRAM?

me-no-dev · 2023-06-20T07:45:37Z

does it mean, when the target is ESP32, psram is not used at all, or is that something totally different?

This is a different thing. It allows direct write from DMA to PSRAM on S2 and S3 (not recommended, but supported). All chips do support PSRAM otherwise.

ESP32-CAM only used ESP32, not S3. And if DMA+ISR is always triggered in case of buffer frames >1 I do not understand, why PSRAM is disturbing the OTA, which in my understanding is happening in the DRAM?

OTA writes to Flash, so not only DRAM used there :)

waynepiekarski · 2023-11-09T05:58:04Z

Just for the record, if you are using arduino-cli it is possible to also get the correct partition table configured without editing any config files:

arduino-cli --fqbn=esp32:esp32:esp32cam compile --build-property build.partitions=min_spiffs --build-property upload.maximum_size=1966080

beta-tester added the Status: Awaiting triage Issue is waiting for triage label Jan 8, 2022

beta-tester changed the title ~~no OTA example is working for AI Thinker ESP32-CAM (wrong partition table?)~~ no OTA example works for AI Thinker ESP32-CAM (wrong partition table?) Jan 11, 2022

VojtechBartoska added Resolution: Awaiting response Waiting for response of author Area: Libraries Issue is related to Library support. and removed Status: Awaiting triage Issue is waiting for triage labels Apr 11, 2022

VojtechBartoska mentioned this issue Apr 22, 2022

NEED help in setting up partition Scheme/Table for ESP32-WROOM-32D (8MB) #4551

Closed

VojtechBartoska added the Type: Example Issue is related to specific example. label May 3, 2022

easytarget mentioned this issue May 8, 2022

Test with Arduino IDE Core 2.0.3 easytarget/esp32-cam-webserver#252

Closed

VojtechBartoska closed this as completed May 9, 2022

VojtechBartoska added Status: Solved and removed Resolution: Awaiting response Waiting for response of author labels May 9, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

no OTA example works for AI Thinker ESP32-CAM (wrong partition table?) #6114

no OTA example works for AI Thinker ESP32-CAM (wrong partition table?) #6114

beta-tester commented Jan 8, 2022 •

edited

Loading

beta-tester commented Jan 9, 2022 •

edited

Loading

Hieromon commented Feb 3, 2022

ChristopheLaurent commented Feb 18, 2022

easytarget commented Mar 10, 2022 •

edited

Loading

VojtechBartoska commented Apr 11, 2022

VojtechBartoska commented May 3, 2022

beta-tester commented May 3, 2022

VojtechBartoska commented May 4, 2022

easytarget commented May 7, 2022

readnotify commented May 28, 2023 •

edited

Loading

GnomiBerlin commented Jun 18, 2023

beta-tester commented Jun 19, 2023 •

edited

Loading

me-no-dev commented Jun 19, 2023

beta-tester commented Jun 19, 2023

GnomiBerlin commented Jun 19, 2023

me-no-dev commented Jun 20, 2023

waynepiekarski commented Nov 9, 2023

no OTA example works for AI Thinker ESP32-CAM (wrong partition table?) #6114

no OTA example works for AI Thinker ESP32-CAM (wrong partition table?) #6114

Comments

beta-tester commented Jan 8, 2022 • edited Loading

Board

Device Description

Hardware Configuration

Version

IDE Name

Operating System

Description

Sketch

Debug Message

Other Steps to Reproduce

I have checked existing issues, online documentation and the Troubleshooting Guide

beta-tester commented Jan 9, 2022 • edited Loading

Hieromon commented Feb 3, 2022

ChristopheLaurent commented Feb 18, 2022

easytarget commented Mar 10, 2022 • edited Loading

VojtechBartoska commented Apr 11, 2022

VojtechBartoska commented May 3, 2022

beta-tester commented May 3, 2022

VojtechBartoska commented May 4, 2022

easytarget commented May 7, 2022

readnotify commented May 28, 2023 • edited Loading

GnomiBerlin commented Jun 18, 2023

beta-tester commented Jun 19, 2023 • edited Loading

me-no-dev commented Jun 19, 2023

beta-tester commented Jun 19, 2023

GnomiBerlin commented Jun 19, 2023

me-no-dev commented Jun 20, 2023

waynepiekarski commented Nov 9, 2023

beta-tester commented Jan 8, 2022 •

edited

Loading

beta-tester commented Jan 9, 2022 •

edited

Loading

easytarget commented Mar 10, 2022 •

edited

Loading

readnotify commented May 28, 2023 •

edited

Loading

beta-tester commented Jun 19, 2023 •

edited

Loading