Hello, @mariom,
Unfortunately, this is not possible.
The sidebar is configured under Appearance >> Widgets >> Shop Sidebar, and it functions as the global sidebar, appearing across all Shop and Category pages. It cannot be set individually for different category pages.
You might want to explore third-party plugins that could better meet your needs.
Best regards,
PThemes Team.
