AI-Assisted Threat Assessment

VerAI supplements technical website checks with AI-generated observations intended to identify potential security warning signs. These assessments can assist with preliminary investigation but should not be interpreted as definitive findings.

How AI Analysis Works

When a website is submitted, VerAI invokes external language-model services with a prompt asking them to assess whether the supplied website appears legitimate or suspicious.

The prompts emphasize potential red flags associated with cybersecurity threats.

AI Integrations

The supplied implementation contains integrations for:

ProviderMain Workflow StatusPurpose
GroqCalled during website analysisGenerate security-focused observations
OpenAICalled during website analysisGenerate security-focused observations
Google GeminiFunction present but not called by the main analysis routeAdditional AI assessment capability in the source

The exact availability of an integration depends on valid credentials, compatible APIs, and service availability.

Running an AI Assessment

  1. Enter a website URL.
  2. Submit the Website Analysis form.
  3. Allow the technical checks and AI calls to complete.
  4. Review any returned AI observations.
  5. Compare those observations with the technical results.

AI results are shown alongside the website analysis data where supported by the results template.

What the AI Is Asked to Evaluate

The implementation requests observations concerning suspicious website behavior and legitimacy.

Topics mentioned in the prompts include:

  • Phishing
  • Scams
  • Malware
  • Other potential security threats
  • General legitimacy concerns

Understanding AI Findings

An AI response may identify potential warning signs such as a suspicious-looking domain name or an apparent impersonation pattern.

However, the supplied code passes the website URL as text to the AI integrations.

It does not pass the complete independently collected technical report into those prompts.

Consequently, the model's observations are not guaranteed to be based on a live inspection of the website.

AI vs. Technical Intelligence

SourceType of Information
DNSObserved domain configuration
TLSObserved connection and certificate data
WHOISRetrieved registration metadata
Safe BrowsingProvider threat-match results
AI AssessmentModel-generated observations

AI analysis should complement, not replace, independent evidence.

False Positives

An AI model may incorrectly characterize a legitimate website as suspicious.

This can occur because of:

  • Unusual domain naming
  • Limited contextual information
  • Outdated model knowledge
  • Ambiguous website identity
  • Inference without direct evidence

False Negatives

An AI model may also fail to recognize malicious websites.

A convincing phishing website can resemble a legitimate service.

New threats or websites may not be known to the model.

External Data Sharing

Website identifiers are submitted to external AI providers.

Users should avoid including confidential information in URLs, such as:

  • Authentication tokens
  • Session identifiers
  • Private query parameters
  • Passwords
  • Sensitive document links

Error Handling

An AI integration may return an error if:

  • Its credentials are invalid
  • The API is unavailable
  • The model is unavailable
  • The request times out
  • The account has reached a usage limit

An AI integration error should not be interpreted as a website security finding.

Important Implementation Detail

The code's copilot_response label refers to a function that calls the OpenAI API.

It should not be assumed to represent a separate Microsoft Copilot security analysis service.

The exact model names in the supplied source may also require updating for compatibility with current provider APIs.

Recommended Use

Use AI output to identify questions worth investigating, then verify those questions against:

  1. Technical website configuration
  2. Trustworthy threat intelligence
  3. Verified organizational information
  4. Independent reporting or evidence
  5. Other appropriate security tools

Remember: AI-generated security observations are advisory and may be inaccurate. They should never be the sole basis for declaring a website safe or malicious.


Did this page help you?