Package ragability
Sub-modules
ragability.checks
-
This module defines the checking functions that are implemented for testing the answers we got from LLMs. The module defines the functions, and …
ragability.config
-
Module for reading/writing config files and merging in information from the arguments. The config file can be in one of the following formats: json, …
ragability.data
-
Module for functions related to reading or writing files and checking file contents.
ragability.logging
-
Module to handle logging. This module is used to set up the logging for the entire package. This uses the Python logging module, but with a more …
ragability.ragability_cc_wc1
-
Module for the CLI to convert the wiki-contradiction corpus to ragability input format
ragability.ragability_check
-
Module to check responses against target facts and assign scores. This creates a result file with the scores which can then be used to calculate …
ragability.ragability_eval
-
Module for the CLI to create evaluation reports from a ragability_check output file.
ragability.ragability_hjson_cat
-
Module for the CLI to concatenate several json or hjson files into one.
ragability.ragability_hjson_info
-
Module for the CLI to concatenate several json or hjson files into one.
ragability.ragability_info
-
Command to print system information and package versions.
ragability.ragability_query
-
Module to run a bunch of ragability queries and get the responses.
ragability.utils
-
Module for various utility functions.
ragability.version