DYN-8494 Add confidence threshold check

[QilongTang]

Purpose

Enable internal check for confidence level threshold, currently set to 0.1% to not impact results number. Although the suggested baseline from Neuron team is 20%, it does not seem to be a proper baseline from my testing with lots of results filtered out..

Declarations

Check these if you believe they are true

• The codebase is in a better state after this PR
• Is documented according to the standards
• The level of testing this PR includes is appropriate
• User facing strings, if any, are extracted into *.resx files
• All tests pass using the self-service CI.
• Snapshot of UI changes, if any.
• Changes to the API follow Semantic Versioning and are documented in the API Changes document.
• This PR modifies some build requirements and the readme is updated
• This PR contains no files larger than 50 MB

Release Notes

N/A

Reviewers

@DynamoDS/synapse

FYIs

(FILL ME IN, Optional) Names of anyone else you wish to be notified of

[github-actions]

See the ticket for this pull request: https://jira.autodesk.com/browse/DYN-8494