1. Client-side screen detection
Detect if we are in the correct screen, by a source image uploaded once.
- Do detection on the client-side
- Solve detection in different screen resolutions...
2. Capture data that the user is entering in the screen
The user enters information in a 3rd-party desktop application, we wish to capture the data he enters.
If the app detected that the screen is relevant - send it to the server and extract the relevant text (inputs) from the image.
3. Push the data
A. To another screen in the desktop app when you detect the correct screen
B. Send it by POST Request to an external app.