Gauth and Symbolab: A Repeatable Math-Solver Test
On this page
Quick answer
The earlier version of this page claimed that Flowith timed Gauth and Symbolab across five problem groups and then published category results. No problem set, raw outputs, timestamps, settings, or reviewer record was attached. Those results have been withdrawn.
Use the same math set in the current Gauth and Symbolab products. Correctness comes before speed: a fast wrong answer or an invalid derivation is not a useful result.
Build a 25-problem set
Use five problems in each category:
- algebra and equations;
- derivatives;
- definite and indefinite integrals;
- linear algebra;
- trigonometric identities.
Include easy, intermediate, and adversarial cases. Keep the expected answer and a verified derivation in a separate answer key. For photo input, include clean print, handwriting, rotated images, and distracting page content.
Do not use live graded work or personally identifying student data.
Record the test conditions
For every attempt, capture:
- date, region, device, and app or web version;
- account plan;
- typed, image, or handwritten input;
- exact problem;
- start and finish time;
- returned answer and steps;
- retries or changed inputs;
- citations or references, if provided.
Test both tools on the same network and in alternating order to reduce time-of-day bias. Repeat failed or unusually slow attempts and keep both observations.
Evaluate the mathematics
A qualified reviewer should check:
- whether the final answer is correct;
- whether each transformation is valid;
- whether domain restrictions and constants are handled;
- whether an alternative form is equivalent;
- whether the explanation teaches or merely states steps;
- whether the tool recognizes ambiguity and asks for clarification.
For symbolic results, substitute values or differentiate/integrate the result where appropriate. Do not let agreement between two solvers substitute for an independent check.
Separate recognition from solving
When an image is used, score transcription before the solution. A solver may apply valid mathematics to an incorrectly recognized expression. Record:
- missing exponents, radicals, or limits;
- confused variables;
- lost matrices or fractions;
- incorrect diagram interpretation;
- whether the user can correct the parsed input.
Compare time responsibly
Report median elapsed time and the range, not a single fastest result. Also record correction time. A slower answer with valid, understandable steps may be more useful than a quick result that needs reconstruction.
Use this worksheet:
| Problem ID | Input type | Correct answer | Valid steps | Recognition error | Elapsed time | Correction time |
|---|
Make a student-centered decision
Choose the tool that helps the student verify reasoning for the actual course and input method. Check current plan limits and pricing inside the official products. Treat both as aids, not authorities, and follow the school’s academic-integrity rules.