Package ragability

Sub-modules

ragability.checks

This module defines the checking functions that are implemented for testing the answers we got from LLMs. The module defines the functions, and …

ragability.config

Module for reading/writing config files and merging in information from the arguments. The config file can be in one of the following formats: json, …

ragability.data

Module for functions related to reading or writing files and checking file contents.

ragability.logging

Module to handle logging. This module is used to set up the logging for the entire package. This uses the Python logging module, but with a more …

ragability.ragability_cc_wc1

Module for the CLI to convert the wiki-contradiction corpus to ragability input format

ragability.ragability_check

Module to check responses against target facts and assign scores. This creates a result file with the scores which can then be used to calculate …

ragability.ragability_eval

Module for the CLI to create evaluation reports from a ragability_check output file.

ragability.ragability_hjson_cat

Module for the CLI to concatenate several json or hjson files into one.

ragability.ragability_hjson_info

Module for the CLI to concatenate several json or hjson files into one.

ragability.ragability_info

Command to print system information and package versions.

ragability.ragability_query

Module to run a bunch of ragability queries and get the responses.

ragability.utils

Module for various utility functions.

ragability.version