* Add support for the hardware CDC in ESP32-C3

* Add initial support for USB MSC

* Add Firmware Upload/Download With MSC

Current running firmware is available as file inside the MSC Disk. To update the firmware on the ESP, just copy a regular firmware bin into the drive

* Support overwriting of the firmware file

Overwriting a file is done totally differently on MacOS, Windows and Linux. This change supports it on all of them.

* Allow CDC, FirmwareMSC and DFU to be enabled on boot

* Add example ESP32-S2 USB-ONLY board

* Various device code optimizations

Added `end()` methods to MSC classes
Made begin() methods safe to be called multiple times
Optimized CDC class

* Fix CDC Connect/Disconnect detection in Arduino IDE on Windows

* Rework cdc_write

* Update ESP32-S2 board configs

esp-dsp: master f4d7d6e
esp-face: master 420fc7e
esp-rainmaker: f1b82c7
esp32-camera: master 6a9497b
esp_littlefs: master b58f00c

* Fix compile archive arguments for the new toolchain

* Add menu to S2 for picking through which port to upload

Internal USB CDC requires to reset and wait for the new port (because persistence is not yet stable)

* USB CDC should also be started in main

* Fix URL and USB version for WebUSB

* Update vendor callback API

* Update CDC::write to use TX_DONE semaphore

* Update USB_Serial example

* Update toolchain

* Update package_esp32_index.template.json

* add optional component dependencies after Kconfig options are known (#5404)

Until this commit, Kconfig options (e.g. CONFIG_TINYUSB_ENABLED) were
used in conditions preceding idf_component_register to determine which
components need to be added to `arduino` component requirements.
However the Kconfig options aren't known at the early expansion stage,
when the component CMakeLists.txt files are expanded the first time
and requirements are evaluated. So all the conditions evaluated as if
the options were not set.
This commit changes the logic to only add these components as
dependencies when the Kconfig options are known. Dependencies become
"weak", which means that if one of the components isn't included into
the build for some reason, it is not added as a dependency.
This may happen, for example, if the component is not present in the
`components` directory or is excluded by setting `COMPONENTS` variable
in the project CMakeLists.txt file.
This also ensures that if the component is not present, it will not be
added as a dependency, and this will allow the build to proceed.

Follow-up to https://github.com/espressif/arduino-esp32/pull/5391.
Closes https://github.com/espressif/arduino-esp32/issues/5319.

* IDF master d93887f9f

* PlatformIO updates for CI (#5387)

* Update PlatformIO CI build script

- Switch to the latest toolchains 8.4.0 for ESP32, ESP32S2, ESP32C3
- Use PlatformIO from master branch for better robustness

* Update package.json for PlatformIO
Co-authored-by: NIvan Grokhotkov <ivan@espressif.com>
Co-authored-by: NValerii Koval <valeros@users.noreply.github.com>

Additional compile arguments can be given by a file named "build_opt.h".
This enables users to easily extend their arguments on a central place.
The script has been taken from stm32duino's Arduino_Core_STM32 package
Co-authored-by: NMe No Dev <me-no-dev@users.noreply.github.com>

esp-dsp: master 7cc5073
esp-face: master 420fc7e
esp-rainmaker: f1b82c7
esp32-camera: master 7a06a7e
esp_littlefs: master b58f00c

esp-dsp: master 7cc5073
esp-face: master 420fc7e
esp-rainmaker: f1b82c7
esp32-camera: master 6f8489e
esp_littlefs: master b58f00c

esp-dsp: master 7cc5073
esp-face: master 420fc7e
esp-rainmaker: f1b82c7
esp32-camera: master 2dded7c
esp_littlefs: master d268e18

done on behalf of @Ladyada, this PR does:

Add Adafruit FunHouse and upcoming Adafruit Feather Esp32s2
Update Adafruit magtag and metro esp32s2 to have tinyuf2 as factory app
Also modify platform.txt as discussed in adafruit#2 + adafruit#3 + adafruit#4 to add support for
Board/variant partition.csv, bootloader.bin ( priority is user sketch > variant > build.parition/boot )
upload.extra_flags to optionally flash tinyuf2 as factory application
Remove duplicated parameter in running python script in linux and windows
Please review and let me know if you want any changes.

Notes: tinyuf2 is a uf2 bootloader for multiple platforms. For esp32s2, it is an factory app to perform uf2 firmware update.

This is very much still work in progress and much more will change before the final 2.0.0

Some APIs have changed. New libraries have been added. LittleFS included.
Co-authored-by: NSeon Rozenblum <seonr@3sprockets.com>
Co-authored-by: NMe No Dev <me-no-dev@users.noreply.github.com>
Co-authored-by: Ngeeksville <kevinh@geeksville.com>
Co-authored-by: NMike Dunston <m_dunston@comcast.net>
Co-authored-by: NUnexpected Maker <seon@unexpectedmaker.com>
Co-authored-by: NSeon Rozenblum <seonr@3sprockets.com>
Co-authored-by: NmicroDev <70126934+microDev1@users.noreply.github.com>
Co-authored-by: Ntobozo <tobozo@users.noreply.github.com>
Co-authored-by: Nbobobo1618 <bobobo1618@users.noreply.github.com>
Co-authored-by: Nlorol <lorolouis@gmail.com>
Co-authored-by: Ngeeksville <kevinh@geeksville.com>
Co-authored-by: NLimor "Ladyada" Fried <limor@ladyada.net>
Co-authored-by: NSweety <switi.mhaiske@espressif.com>
Co-authored-by: NLoick MAHIEUX <loick111@gmail.com>
Co-authored-by: NLarry Bernstone <lbernstone@gmail.com>
Co-authored-by: NValerii Koval <valeros@users.noreply.github.com>
Co-authored-by: N快乐的我531 <2302004040@qq.com>
Co-authored-by: Nchegewara <imperiaonline4@gmail.com>
Co-authored-by: NClemens Kirchgatterer <clemens@1541.org>
Co-authored-by: NAron Rubin <aronrubin@gmail.com>
Co-authored-by: NPete Lewis <601236+lewispg228@users.noreply.github.com>

Previously sketches or examples that had spaces anywhere in their absolute
path caused a total build failure. By adding quotes around the path in
platform.txt, they now build correctly
Co-authored-by: NMe No Dev <me-no-dev@users.noreply.github.com>

esp-face: master 420fc7e
esp32-camera: master 488c308

esp-face: master 420fc7e
esp32-camera: master 770f26a

esp-face: master 420fc7e
esp32-camera: master a5ccbec

* Update IDF to d8082b7f3

Co-authored-by: Nme-no-dev <me-no-dev@github.com>

esp-face: master 420fc7e
esp32-camera: master 0107093

esp-face: master 420fc7e
esp32-camera: master 0107093

ESP-IDF release/v3.3: 66d3783c8
esp-face: 420fc7e
esp32-camera: 0107093

This is in line with the
[arduino platform specification](https://arduino.github.io/arduino-cli/platform-specification/#recipes-for-extraction-of-executable-files-and-other-binary-data)
specifying that the file extension after recipe.objcopy is arbitrary and
that the AVR platform uses `eep` & `hex`, while the esp32 platform seems
to have file extensions `partition.bin` & `bin`

The latest versions of Arduino IDE shifted the responsibility for precompiled libraries support to the core developers, which breaks precompiled library support in esp32 Arduino core. See https://github.com/arduino/ArduinoCore-avr/pull/52 for more details:

```
In this new version of the builder we are not doing any heuristics to find the right spot where the ldflags should be inserted (this was causing many bugs on its own); instead, we fully trust the core makers to add explicit support to precompiled libs.
```

This chage re-enables precompiled library support in the esp32 Arduino core.

Add support for the v1.8.6 compiler.libraries.ldflags:

https://github.com/arduino/Arduino/wiki/Arduino-IDE-1.5:-Library-specification

This fixes the issue reported here:

https://community.bosch-sensortec.com/t5/MEMS-sensors-forum/BSEC-1-4-7-4-compilation-error-on-ESP32-1-0-3-rc1/td-p/9120

* IDF release/v3.3 46b12a560

* fix build

* IDF release/v3.3 367c3c09c

Add a file named `partitions.csv` to your sketch folder and define the partitions inside. In order to not get `Sketch too big`, please select appropriate partition scheme from the board menu

* Update IDF to v3.2 977854975

* Update app_httpd.cpp

fixes: https://github.com/espressif/arduino-esp32/issues/2758

* Set IDF to v3.2

* Remove BLE submodule

* Add BLE lib source

* Update Camera example to support OV3660

- ESP-Face to 2937054
- ESP32-Camera to 113629b

* Update IDF to e931fe9 and add esp-face

* Fix PIO builds fail because of sketch size

* Fix example build failing for Arduino