sokwedb
2 years agoAdjust conversion to load BIOGRAPHY_DATA instead of BIOGRAPHY
Karl O. Pinc kop@karlpinc.com [Wed, 31 Jan 2024 00:46:03 +0000 (00:46 +0000)]
Adjust conversion to load BIOGRAPHY_DATA instead of BIOGRAPHY

2 years agoCreate BIOGRAPHY view
Karl O. Pinc [Wed, 31 Jan 2024 00:06:41 +0000 (18:06 -0600)]
Create BIOGRAPHY view

2 years agoAdd _error_immutable_view function to support un-updateable views
Karl O. Pinc [Wed, 31 Jan 2024 00:05:36 +0000 (18:05 -0600)]
Add _error_immutable_view function to support un-updateable views

2 years agoNote how the table listing a view's columns should be constructed
Karl O. Pinc [Wed, 31 Jan 2024 00:02:24 +0000 (18:02 -0600)]
Note how the table listing a view's columns should be constructed

2 years agoAdd DROP_EXISTING variable to for when there's no 'drop' file
Karl O. Pinc [Wed, 31 Jan 2024 00:01:22 +0000 (18:01 -0600)]
Add DROP_EXISTING variable to for when there's no 'drop' file

2 years agoFix so "make check" works after recreate-db target
Karl O. Pinc [Tue, 30 Jan 2024 23:59:38 +0000 (17:59 -0600)]
Fix so "make check" works after recreate-db target

2 years agoAdd caution that remaking triggers or views drop triggers
Karl O. Pinc [Tue, 30 Jan 2024 23:13:38 +0000 (17:13 -0600)]
Add caution that remaking triggers or views drop triggers

2 years agoChange name of view dir to avoid name conflict with rst source dirs
Karl O. Pinc [Tue, 30 Jan 2024 17:25:36 +0000 (11:25 -0600)]
Change name of view dir to avoid name conflict with rst source dirs

2 years agoUse consistent variable naming conventions
Karl O. Pinc [Tue, 30 Jan 2024 17:22:32 +0000 (11:22 -0600)]
Use consistent variable naming conventions

2 years agoRaise an exception if we don't find the view code
Karl O. Pinc [Tue, 30 Jan 2024 17:19:49 +0000 (11:19 -0600)]
Raise an exception if we don't find the view code

2 years agoAutomatically generate statements to drop views
Karl O. Pinc [Tue, 30 Jan 2024 15:44:12 +0000 (09:44 -0600)]
Automatically generate statements to drop views

2 years agoRequire that the CREATE VIEW explicitly list column names
Karl O. Pinc [Tue, 30 Jan 2024 17:18:20 +0000 (11:18 -0600)]
Require that the CREATE VIEW explicitly list column names

2 years agoAutomatically generate statements to drop views
Karl O. Pinc [Tue, 30 Jan 2024 15:44:12 +0000 (09:44 -0600)]
Automatically generate statements to drop views

2 years agoFix (typos in) review target
Karl O. Pinc [Tue, 30 Jan 2024 15:38:52 +0000 (09:38 -0600)]
Fix (typos in) review target

2 years agoChange BIOGRAPHY table name to BIOGRAPHY_DATA
Karl O. Pinc [Mon, 29 Jan 2024 22:27:53 +0000 (16:27 -0600)]
Change BIOGRAPHY table name to BIOGRAPHY_DATA

2 years agoReflect change of lookup schema to "codes" in conversion code
Karl O. Pinc [Mon, 29 Jan 2024 19:52:08 +0000 (13:52 -0600)]
Reflect change of lookup schema to "codes" in conversion code

2 years agoChange the name of the lookup schema to "codes"
Karl O. Pinc [Mon, 29 Jan 2024 19:12:14 +0000 (13:12 -0600)]
Change the name of the lookup schema to "codes"

2 years agoImprove code formatting
Karl O. Pinc [Mon, 29 Jan 2024 19:10:47 +0000 (13:10 -0600)]
Improve code formatting

2 years agoCleanup after moving triggers into db/schemas/lib/
Karl O. Pinc [Mon, 29 Jan 2024 19:09:18 +0000 (13:09 -0600)]
Cleanup after moving triggers into db/schemas/lib/

2 years agoFix and imprprove error message
Karl O. Pinc [Mon, 29 Jan 2024 19:04:27 +0000 (13:04 -0600)]
Fix and imprprove error message

2 years agoImprove docs on clean targets
Karl O. Pinc [Mon, 29 Jan 2024 18:46:29 +0000 (12:46 -0600)]
Improve docs on clean targets

2 years agoAdd clean-commands target for scripts
Karl O. Pinc [Mon, 29 Jan 2024 18:45:47 +0000 (12:45 -0600)]
Add clean-commands target for scripts

2 years agodefault_transaction_deferrable=on, backslash_quote=off
Karl O. Pinc kop@karlpinc.com [Wed, 24 Jan 2024 22:50:33 +0000 (22:50 +0000)]
default_transaction_deferrable=on, backslash_quote=off

2 years agoThe php-fpm interpreter is not deprecated
Karl O. Pinc kop@karlpinc.com [Mon, 22 Jan 2024 21:18:07 +0000 (21:18 +0000)]
The php-fpm interpreter is not deprecated

2 years agoConvert BIOGRAPHY_LOG
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 21:04:35 +0000 (21:04 +0000)]
Convert BIOGRAPHY_LOG

2 years agoClean up "biography_update_log.made by" column to remove space
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 20:56:51 +0000 (20:56 +0000)]
Clean up "biography_update_log.made by" column to remove space

2 years agoMake a PEOPLE table in the "clean" schema to support bad data queries
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 20:56:03 +0000 (20:56 +0000)]
Make a PEOPLE table in the "clean" schema to support bad data queries

2 years agoIndex biography_log and comm_memb_log
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 19:29:00 +0000 (19:29 +0000)]
Index biography_log and comm_memb_log

2 years agoAdd LIMIT to SELECT INTO, and ORDER BY for consistant errors results
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 19:19:30 +0000 (19:19 +0000)]
Add LIMIT to SELECT INTO, and ORDER BY for consistant errors results

2 years agoFix AnimID column docs, must not be null, plus other columns
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 18:12:00 +0000 (18:12 +0000)]
Fix AnimID column docs, must not be null, plus other columns

2 years agoCreate BIOGRAPHY_LOG and update docs with actual constraints
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 17:58:52 +0000 (17:58 +0000)]
Create BIOGRAPHY_LOG and update docs with actual constraints

2 years agoDocument BIOGRAPHY_LOG
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 17:40:49 +0000 (17:40 +0000)]
Document BIOGRAPHY_LOG

2 years agoRemove empty trailing line
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 17:38:14 +0000 (17:38 +0000)]
Remove empty trailing line

2 years agoMove DadID, DadIDPub, and DadPrelim relationships into the overview
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 16:38:03 +0000 (16:38 +0000)]
Move DadID, DadIDPub, and DadPrelim relationships into the overview

2 years agoMention both column names in the iff NULL docs
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 16:37:59 +0000 (16:37 +0000)]
Mention both column names in the iff NULL docs

2 years agoNote what the special quotes are
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 16:35:32 +0000 (16:35 +0000)]
Note what the special quotes are

2 years agoAdd BIOGRAPHY.DadPrelim substitution refrence
Karl O. Pinc kop@karlpinc.com [Sat, 20 Jan 2024 16:28:20 +0000 (16:28 +0000)]
Add BIOGRAPHY.DadPrelim substitution refrence

2 years agoIn diagram, change name BIOGRAPHY->BIOGRAPHY_DATA and add DadIDPrelim column
Karl O. Pinc [Fri, 19 Jan 2024 23:02:42 +0000 (17:02 -0600)]
In diagram, change name BIOGRAPHY->BIOGRAPHY_DATA and add DadIDPrelim column

2 years agoReduce the HTML sidebar table of contents level to 2
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 22:48:54 +0000 (22:48 +0000)]
Reduce the HTML sidebar table of contents level to 2

2 years agoBetter docs for DATA_FILE conversion variable
Karl O. Pinc [Tue, 12 Dec 2023 00:10:01 +0000 (18:10 -0600)]
Better docs for DATA_FILE conversion variable

2 years agoRemove more code which worked around invalid primary key data in dump
Karl O. Pinc [Tue, 12 Dec 2023 00:07:59 +0000 (18:07 -0600)]
Remove more code which worked around invalid primary key data in dump

This goes with commit: ea49f4a06a

2 years agoNew limits ("final" for the ones that exist now) based on group meeting
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 19:53:52 +0000 (19:53 +0000)]
New limits ("final" for the ones that exist now) based on group meeting

2 years agoUpdate based on initial data conversion
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 16:47:44 +0000 (16:47 +0000)]
Update based on initial data conversion

2 years agoEnforce rule that EntryDate <= DepartDate
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:39:02 +0000 (14:39 +0000)]
Enforce rule that EntryDate <= DepartDate

2 years agoAlign community code max length with that of the code table
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:25:01 +0000 (14:25 +0000)]
Align community code max length with that of the code table

2 years agoTesting for contiguous membership requires membership in one community
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:23:35 +0000 (14:23 +0000)]
Testing for contiguous membership requires membership in one community

2 years agoFix syntax error
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:22:13 +0000 (14:22 +0000)]
Fix syntax error

2 years agoLoad DadIDPrelim; adjust DadID and DadIDPub accordingly
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:21:14 +0000 (14:21 +0000)]
Load DadIDPrelim; adjust DadID and DadIDPub accordingly

2 years agoRemove trailing newlines from file
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:19:18 +0000 (14:19 +0000)]
Remove trailing newlines from file

2 years agoDo not limit AnimID length, to match BIOGRAPHY
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:15:47 +0000 (14:15 +0000)]
Do not limit AnimID length, to match BIOGRAPHY

2 years agoAdd missing FROM clauses
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 14:14:36 +0000 (14:14 +0000)]
Add missing FROM clauses

2 years agoFix minimum age of parent at time of birth calculation
Karl O. Pinc kop@karlpinc.com [Fri, 19 Jan 2024 01:45:09 +0000 (01:45 +0000)]
Fix minimum age of parent at time of birth calculation

2 years agoCleanup data required to tidy data types, fixes problem #10
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 22:56:20 +0000 (22:56 +0000)]
Cleanup data required to tidy data types, fixes problem #10

2 years agoImprove description of file
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:47:06 +0000 (21:47 +0000)]
Improve description of file

2 years agoThese cleanups were done in the upstream data
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:45:12 +0000 (21:45 +0000)]
These cleanups were done in the upstream data

2 years agoExplain why permissions are set only on raw
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:42:38 +0000 (21:42 +0000)]
Explain why permissions are set only on raw

2 years agoHave BIOGRAPHY.DadIDPub follow the same NULL rules as DadPrelim
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:38:01 +0000 (21:38 +0000)]
Have BIOGRAPHY.DadIDPub follow the same NULL rules as DadPrelim

This change is questionable, since querying on DadIDPub would be
slightly wonky.  But we don't really anticipate queries.

2 years agoAdd BIOGRAPHY.DadID_Prelim column
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:37:06 +0000 (21:37 +0000)]
Add BIOGRAPHY.DadID_Prelim column

2 years agoNew macro for if and only if NULL values
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:10:08 +0000 (21:10 +0000)]
New macro for if and only if NULL values

2 years agoBetter BIOGRAPHY.DadID description
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:08:36 +0000 (21:08 +0000)]
Better BIOGRAPHY.DadID description

2 years agoNote where BIOGRAPHY.AnimIDs come from
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 21:06:29 +0000 (21:06 +0000)]
Note where BIOGRAPHY.AnimIDs come from

2 years agoReword the standard "empty text" phrasings
Karl O. Pinc kop@karlpinc.com [Thu, 18 Jan 2024 20:44:13 +0000 (20:44 +0000)]
Reword the standard "empty text" phrasings

2 years agoRevert all code that changes the FOLLOW_MAP_TIME DDL statement on db load
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 09:16:25 +0000 (09:16 +0000)]
Revert all code that changes the FOLLOW_MAP_TIME DDL statement on db load

The data still contains duplicate keys.

This reverts commit ea49f4a06ac3ef8c2aec1e8fbc0c08703bca36d7.
This reverts commit 3e206bacf3a14ed9a242e766c1b1e590104890dc.

2 years agoDo not change the FOLLOW_MAP_TIME DDL statement at all
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 09:08:55 +0000 (09:08 +0000)]
Do not change the FOLLOW_MAP_TIME DDL statement at all

Finishes the fix made in ea49f4a06ac.

2 years agoProperly pick up variables from the environment
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 02:45:18 +0000 (02:45 +0000)]
Properly pick up variables from the environment

2 years agoImprove docs for create-schema target
Karl O. Pinc kop@karlpinc.com [Wed, 17 Jan 2024 02:43:57 +0000 (02:43 +0000)]
Improve docs for create-schema target

2 years agoProgress towards moving demography data into a production-like structure
Karl O. Pinc [Thu, 30 Nov 2023 21:31:11 +0000 (15:31 -0600)]
Progress towards moving demography data into a production-like structure

2 years agoFix max lifespan constraint
Karl O. Pinc [Thu, 30 Nov 2023 20:31:14 +0000 (14:31 -0600)]
Fix max lifespan constraint

2 years agoChange BIOGRAPHY.AnimIDNum to allow NULL, and fix constraint
Karl O. Pinc [Thu, 30 Nov 2023 19:47:46 +0000 (13:47 -0600)]
Change BIOGRAPHY.AnimIDNum to allow NULL, and fix constraint

2 years agoFix column indexed
Karl O. Pinc [Thu, 30 Nov 2023 19:24:38 +0000 (13:24 -0600)]
Fix column indexed

2 years agoAllow spaces in Name column; align code with docs
Karl O. Pinc [Tue, 28 Nov 2023 21:05:12 +0000 (15:05 -0600)]
Allow spaces in Name column; align code with docs

2 years agoFix permissions
Karl O. Pinc [Tue, 28 Nov 2023 19:59:11 +0000 (13:59 -0600)]
Fix permissions

2 years agoFix comments
Karl O. Pinc [Tue, 28 Nov 2023 19:21:57 +0000 (13:21 -0600)]
Fix comments

2 years agoConvert data from the tidy to the easy schema
Karl O. Pinc [Tue, 28 Nov 2023 18:31:06 +0000 (12:31 -0600)]
Convert data from the tidy to the easy schema

2 years agoFix to use command line argument
Karl O. Pinc [Tue, 28 Nov 2023 18:07:56 +0000 (12:07 -0600)]
Fix to use command line argument

2 years agoRequire COMM_IDS.Name be unique
Karl O. Pinc [Tue, 28 Nov 2023 17:07:19 +0000 (11:07 -0600)]
Require COMM_IDS.Name be unique

2 years agoImprove hint; SokweDB has "admin"s and no real superusers
Karl O. Pinc [Sun, 26 Nov 2023 21:22:13 +0000 (15:22 -0600)]
Improve hint; SokweDB has "admin"s and no real superusers

2 years agoDocument the "lib" schema
Karl O. Pinc [Sun, 26 Nov 2023 21:21:19 +0000 (15:21 -0600)]
Document the "lib" schema

2 years agoFix typo
Karl O. Pinc [Sun, 26 Nov 2023 20:23:21 +0000 (14:23 -0600)]
Fix typo

2 years agoMove triggers and functions the user need not see into the "lib" schema
Karl O. Pinc [Sun, 26 Nov 2023 20:22:37 +0000 (14:22 -0600)]
Move triggers and functions the user need not see into the "lib" schema

2 years agoDo not need to remove primary key declaration, the data has been cleaned
Karl O. Pinc [Sun, 19 Nov 2023 00:16:00 +0000 (18:16 -0600)]
Do not need to remove primary key declaration, the data has been cleaned

2 years agoConvert data into the tidy schema
Karl O. Pinc [Sun, 12 Nov 2023 20:46:34 +0000 (14:46 -0600)]
Convert data into the tidy schema

As of now, this means cleaning up the data types of the "raw" schema
and checking that this does not discard any data.

2 years agoSeparate psql setup vars for different schemas
Karl O. Pinc [Thu, 9 Nov 2023 21:24:16 +0000 (15:24 -0600)]
Separate psql setup vars for different schemas

2 years agoStop if there's an error loading the db
Karl O. Pinc [Thu, 9 Nov 2023 20:03:12 +0000 (14:03 -0600)]
Stop if there's an error loading the db

2 years agoMake executable
Karl O. Pinc [Thu, 9 Nov 2023 16:54:50 +0000 (10:54 -0600)]
Make executable

2 years agoChange default conversion schema to "raw"
Karl O. Pinc [Thu, 9 Nov 2023 16:33:42 +0000 (10:33 -0600)]
Change default conversion schema to "raw"

2 years agoSeparate file for db speed settings
Karl O. Pinc [Thu, 9 Nov 2023 16:31:58 +0000 (10:31 -0600)]
Separate file for db speed settings

2 years agoMake "old" the default db for converting
Karl O. Pinc [Thu, 9 Nov 2023 16:24:25 +0000 (10:24 -0600)]
Make "old" the default db for converting

2 years agoSystem to load MS Access dump into Postgres
Karl O. Pinc [Thu, 9 Nov 2023 16:20:16 +0000 (10:20 -0600)]
System to load MS Access dump into Postgres

2 years agoUse variable instead of hardcoding
Karl O. Pinc [Tue, 7 Nov 2023 18:45:17 +0000 (12:45 -0600)]
Use variable instead of hardcoding

2 years agoRedo the table name arrow
Karl O. Pinc [Fri, 3 Nov 2023 22:08:02 +0000 (17:08 -0500)]
Redo the table name arrow

For reasons not understood, the arrow glyph at the end of the
old arrow was rotated 90 degrees when displayed on the web page.

2 years agoConfigure Sphinx theme and RST figures to display SVG full-screen width
Karl O. Pinc [Mon, 30 Oct 2023 21:25:10 +0000 (16:25 -0500)]
Configure Sphinx theme and RST figures to display SVG full-screen width

2 years agoThe demography er diagram
Karl O. Pinc [Fri, 27 Oct 2023 22:39:26 +0000 (17:39 -0500)]
The demography er diagram

2 years agoMove system-level commands into the sokwe_server repo
Karl O. Pinc kop@karlpinc.com [Fri, 20 Oct 2023 21:11:18 +0000 (21:11 +0000)]
Move system-level commands into the sokwe_server repo

2 years agoDocument hardcoding of cluster init and provide related control variables
Karl O. Pinc [Sun, 15 Oct 2023 17:48:47 +0000 (12:48 -0500)]
Document hardcoding of cluster init and provide related control variables

2 years agoFix copyright/author contact info
Karl O. Pinc [Fri, 13 Oct 2023 15:33:40 +0000 (10:33 -0500)]
Fix copyright/author contact info

2 years agoNew command to support VPN for port forwarding to pg server
Karl O. Pinc kop@karlpinc.com [Fri, 13 Oct 2023 16:24:10 +0000 (16:24 +0000)]
New command to support VPN for port forwarding to pg server

2 years agodocs: added url to wikipage on build system
Stevan Earl [Thu, 12 Oct 2023 18:00:30 +0000 (11:00 -0700)]
docs: added url to wikipage on build system

Providing richer resources for working with the build system that are
beyond the scope of the Make documentation.

2 years agoTransaction isolation is now configured to be serializable
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 03:00:13 +0000 (03:00 +0000)]
Transaction isolation is now configured to be serializable

There are also new settings for PG 15, but it's too much of a hassle
to break these into a separate commit.  Especially since there's
no production data yet.

2 years agoNew az server settings removed "anon" from available shared libraries
Karl O. Pinc kop@karlpinc.com [Mon, 9 Oct 2023 02:54:42 +0000 (02:54 +0000)]
New az server settings removed "anon" from available shared libraries