Pymidscene
PyMidscene is a Python SDK for Midscene.js, an AI-powered UI automation framework that enables developers to control web browsers, Android devices, and iOS simulators using natural language instead of traditional CSS selectors or XPath. By leveraging vision large language models like Doubao, Qwen, GPT-4V, and Claude, it allows users to describe actions in plain English or Chinese, such as clicking a specific button or extracting data fields. Key features include seamless integration with Playwright for web automation, support for real Android devices via ADB, and iOS simulation through WebDriverAgent. The tool offers smart XPath caching fully compatible with the official Midscene.js format, generates visual HTML reports for debugging, and provides full type hinting for enhanced IDE support. It simplifies complex automation scripts, making them more readable and maintainable by eliminating fragile selector dependencies. PyMidscene requires Python 3.10+ and supports installation via pip or Poetry, making it an