NEWS.md
check_environment_setup()
?cs9)check_environment_setup() documentation with detailed examplesget_config_log() function to retrieve configuration log entries from the config_log table.
ss), task name (task), and date range (start_date, end_date).data.table with the filtered entries.update_config_log() to also route custom messages (...) to the message() function for clearer console output.update_config_log function. Logs configuration updates including surveillance system (ss), task name (task), and a custom message.as.character(lubridate::now()) adds microseconds, which breaks the SQL upload. This is now replaced by cstime::now_c().DBPartitionedTableExtended_v9$info() bug fixed with argument collapse=TRUE.confirm_indexes in DBPartitionedTableExtended_v9.DBPartitionedTableExtended_v9$nrow() now has a new argument collapse=FALSE that provides partion-specific resultsDBPartitionedTableExtended_v9$info() now includes sizes in MBDBPartitionedTableExtended_v9 so that it is easier to use multiple partitioning variables.partitions_randomized in DBPartitionedTableExtended_v9 so that when running in parallel, the database tables don’t get locked.remove_table in DBPartitionedTableExtended_v9
get_config_tasks_stats
DBTableExtended_v9 now automatically includes a column for all tables, called auto_last_updated_datetime, which is automatically calculated each time that row is changed.DBPartitionedTableExtended_v9, which allows for one dataset to be partitioned amongst multiple SQL tables automatically.SurveillanceSystem_v9 constructor now takes in an argument called implementation_version, which can be used to identify what version of analytics code is currently being run.update_config_last_updated has now been replaced by update_config_tables_last_updated (which contains when the tables were last updated) and config_tasks_stats (which contains all the runtimes of the tasks).SurveillanceSystem_v9 now uses an internal R6 class DBTableExtended_v9 (which extends csdb::DBTable_v9) instead of using csdb::DBTable_v9 directly. DBTableExtended_v9 calls update_config_last_updated after altering a database table.copy_into_new_table_where now also copies indexes.copy_into_new_table_where uses tablock.upsert_at_end_of_each_plan and insert_at_end_of_each_plan can now take named lists as the return value from the action_fn.sc8::add_task_from_config_v8 the schema list is checked to make sure they are actually schemas. This will solve the issue where people incorrectly add non-existent schemas to the task.insert_data, upsert_data, drop_all_rows_and_then_insert_data are now the recommended ways of inserting dataaddin_load_productionload_folder_fn, which should dynamically check if a user has permission to write to a folder, solving permissions errorstm_get_schema_names
granularity_time AND granularity_geo are now included in db censorssc8::config$plan_attempt_index now exists. When running plans in parallel, if a plan fails it is retried five times. This lets a user track which attempt they are on. This is mostly useful so that emails and smses are only sent when sc8::config$plan_attempt_index==1
task_from_config_v8 and add_schema_v8
db_insert_data, db_upsert_data, db_drop_all_rows_and_then_upsert_data are now the recommended ways of inserting dataupdate_config_datetime and get_config_datetime now automatically record database table updates as welltask_from_config_v3 sets a new direction for creation of tasks and management of tasksdescribe_tasks and describe_schemas help with automatic documentationtask_inline_v1 allows for easy inline task creationcopy_into_new_table_where allows for the creation of a new table from an old tabletask_from_config_v2