Code

Plugin Update#1

Code

Open

wajones98 wants to merge 156 commits intomainSmdhMdep/ckanext-falkor2:mainfrom wajonesSmdhMdep/ckanext-falkor2:wajonesCopy head branch name to clipboard

+1,429-215

Commits

Commits on Feb 8, 2024

• create dataset

  wajones98

  committed
  f3d059d

  Copy full SHA for f3d059d

• document creation

  wajones98

  committed
  e958ab0

  Copy full SHA for e958ab0

• remaining crud operations for documents

  wajones98

  committed
  24efc85

  Copy full SHA for 24efc85

• Fix documentRead

  wajones98

  committed
  2bb92e5

  Copy full SHA for 2bb92e5

Commits on Feb 9, 2024

• Authentication

  wajones98

  committed
  5b39661

  Copy full SHA for 5b39661

• Add config

  wajones98

  committed
  3a316a8

  Copy full SHA for 3a316a8

Commits on Feb 13, 2024

• Load values from config

  wajones98

  committed
  be2b824

  Copy full SHA for be2b824

Commits on Feb 14, 2024

• Move document create to falkor_client

  wajones98

  committed
  51f801a

  Copy full SHA for 51f801a

• move delete and update to falkor_client

  wajones98

  committed
  c9e9839

  Copy full SHA for c9e9839

• Move datasetCreate to falkor client

  wajones98

  committed
  b93865f

  Copy full SHA for b93865f

• remove task2 and fix create_dataset call

  wajones98

  committed
  943daba

  Copy full SHA for 943daba

• fix falkorDelete method name

  wajones98

  committed
  b9e1dab

  Copy full SHA for b9e1dab

Commits on Feb 16, 2024

• Use config for remaining values

  wajones98

  committed
  9e85a3a

  Copy full SHA for 9e85a3a

Commits on Feb 21, 2024

• Add user_ids to audit events

  wajones98

  committed
  d2b04f9

  Copy full SHA for d2b04f9

Commits on Apr 9, 2024

• Add audit button to resource button action panel

  wajones98

  committed
  224ac92

  Copy full SHA for 224ac92

• Cleanup unused vars/imports

  wajones98

  committed
  30baa1e

  Copy full SHA for 30baa1e

• Render audit in table on the resource view page

  wajones98

  committed
  e17148e

  Copy full SHA for e17148e

Commits on Apr 11, 2024

• Revert audit template to external link

  wajones98

  committed
  569aaca

  Copy full SHA for 569aaca

Commits on Apr 15, 2024

• Adjust position of audit button

  wajones98

  committed
  a51d1d3

  Copy full SHA for a51d1d3

• Adjust audit url and add query params

  wajones98

  committed
  a6abfb3

  Copy full SHA for a6abfb3

Commits on Apr 18, 2024

• read audit base url from config

  wajones98

  committed
  2c349a0

  Copy full SHA for 2c349a0

• Org id handling refactor

  wajones98

  committed
  225b78e

  Copy full SHA for 225b78e

Commits on Oct 3, 2024

• Move access token to job

  Show description for b39e33d
  wajones98

  committed
  b39e33d

  Copy full SHA for b39e33d

Commits on Oct 4, 2024

• Remove unused import

  wajones98

  committed
  d19ff4b

  Copy full SHA for d19ff4b

• Rename resource -> package

  wajones98

  committed
  f299bdf

  Copy full SHA for f299bdf

• Log package activity stream

  wajones98

  committed
  b171e26

  Copy full SHA for b171e26

Commits on Oct 7, 2024

• bug fix: move toolkit userobj access outside of worker

  wajones98

  committed
  b00b586

  Copy full SHA for b00b586

Commits on Oct 8, 2024

• Remove test log

  wajones98

  committed
  bde1b76

  Copy full SHA for bde1b76

• formatting

  wajones98

  committed
  1c1c344

  Copy full SHA for 1c1c344

• Create dataset_sync table and load with existing datasets

  wajones98

  committed
  4e87a6b

  Copy full SHA for 4e87a6b

• Load dataset ids as part of migration

  wajones98

  committed
  6840355

  Copy full SHA for 6840355

• Use resource model instead of dict

  wajones98

  committed
  3c8a631

  Copy full SHA for 3c8a631

Commits on Oct 9, 2024

• Log event to table

  wajones98

  committed
  96c8d7d

  Copy full SHA for 96c8d7d

Commits on Oct 10, 2024

• Test custom_action

  wajones98

  committed
  e3d9b27

  Copy full SHA for e3d9b27

• New EventHandler class

  wajones98

  committed
  d4cce71

  Copy full SHA for d4cce71

Commits on Oct 15, 2024

• Refactor events to event_handler

  wajones98

  committed
  88ba7ac

  Copy full SHA for 88ba7ac

• Rename falkor_client -> client

  wajones98

  committed
  bf3a6c3

  Copy full SHA for bf3a6c3

• Temporarily remove actions plugin

  wajones98

  committed
  c8a4a9e

  Copy full SHA for c8a4a9e

• Add event type to event_handler

  wajones98

  committed
  3bd1df6

  Copy full SHA for 3bd1df6

• Improve package create event

  wajones98

  committed
  31edc47

  Copy full SHA for 31edc47

• Add TODO

  wajones98

  committed
  2d3b5c3

  Copy full SHA for 2d3b5c3

• Add todo and check resource state before logging event

  wajones98

  committed
  731934d

  Copy full SHA for 731934d

• Capture resource events

  wajones98

  committed
  437f6c4

  Copy full SHA for 437f6c4

Commits on Oct 17, 2024

• Add seq to read events

  wajones98

  committed
  b2e29bf

  Copy full SHA for b2e29bf

• Add some TODOS and clean up comments

  wajones98

  committed
  a0af9ef

  Copy full SHA for a0af9ef

Commits on Oct 21, 2024

• Remove event sequence

  wajones98

  committed
  af370fd

  Copy full SHA for af370fd

• config migration

  wajones98

  committed
  691f9cd

  Copy full SHA for 691f9cd

• Remove sequence from event model

  wajones98

  committed
  213dbcf

  Copy full SHA for 213dbcf

• Move event processing back to worker

  wajones98

  committed
  69fd68a

  Copy full SHA for 69fd68a

Commits on Oct 22, 2024

• Check plugin is initialised before tracking events

  wajones98

  committed
  5aee350

  Copy full SHA for 5aee350

• Validate config on plugin startup

  wajones98

  committed
  26380b2

  Copy full SHA for 26380b2

• initialise plugin function

  wajones98

  committed
  2cf4d47

  Copy full SHA for 2cf4d47

• Remove falkor config table and introduce sync job

  wajones98

  committed
  0662a0f

  Copy full SHA for 0662a0f

• Add migration for sync job history

  wajones98

  committed
  83307ce

  Copy full SHA for 83307ce

• insert sync job

  wajones98

  committed
  32d79d4

  Copy full SHA for 32d79d4

• Refactor package_create to reprocess events

  wajones98

  committed
  8fee68a

  Copy full SHA for 8fee68a

Commits on Oct 23, 2024

• Make event_handler handlers compatible with sync job

  wajones98

  committed
  668983f

  Copy full SHA for 668983f

• Simplify event handling

  wajones98

  committed
  f72c20f

  Copy full SHA for f72c20f

• Remove sync job run in plugin startup

  wajones98

  committed
  06e40b4

  Copy full SHA for 06e40b4

• Remove unused plugin properties

  wajones98

  committed
  1cb9dc6

  Copy full SHA for 1cb9dc6

• Add processing status to events

  wajones98

  committed
  e919d1d

  Copy full SHA for e919d1d

• Change event_handler to class

  wajones98

  committed
  bc70d70

  Copy full SHA for bc70d70

• Add timeout to auth post requests

  wajones98

  committed
  1dbb1d1

  Copy full SHA for 1dbb1d1

• Add return type to falkor api requests

  wajones98

  committed
  00939c7

  Copy full SHA for 00939c7

• Reintroduce package create events for falkor

  wajones98

  committed
  79ba78c

  Copy full SHA for 79ba78c

• Do not process resources that still have a pending create package event

  wajones98

  committed
  bef3be7

  Copy full SHA for bef3be7

Commits on Oct 24, 2024

• Events for new documents

  wajones98

  committed
  e253b8f

  Copy full SHA for e253b8f

• Add events for existing documents

  wajones98

  committed
  5be0bd9

  Copy full SHA for 5be0bd9

• Move processing location and remove response() from exception

  wajones98

  committed
  417dbf8

  Copy full SHA for 417dbf8

• Pass entity to event handler and fix created_at

  wajones98

  committed
  e1cc8dc

  Copy full SHA for e1cc8dc

• Remove created_at from before_show

  wajones98

  committed
  ded98c2

  Copy full SHA for ded98c2

• Update temp read filter to use regex

  wajones98

  committed
  5ada201

  Copy full SHA for 5ada201

• Reintroduce dict and org id

  wajones98

  committed
  50f1363

  Copy full SHA for 50f1363

Commits on Oct 28, 2024

• Add entity to sync jobs

  wajones98

  committed
  cde1a98

  Copy full SHA for cde1a98

• Add admin tab

  wajones98

  committed
  22997e7

  Copy full SHA for 22997e7

• Properly inheirt admin page

  wajones98

  committed
  c9ed66d

  Copy full SHA for c9ed66d

• Start sync job from admin button

  wajones98

  committed
  be41028

  Copy full SHA for be41028

Commits on Oct 29, 2024

• UI for Falkor admin tab

  wajones98

  committed
  f6edacf

  Copy full SHA for f6edacf

• Add order by to failed events

  wajones98

  committed
  590fc25

  Copy full SHA for 590fc25

Commits on Oct 30, 2024

• Refactor metadata

  wajones98

  committed
  548c992

  Copy full SHA for 548c992

Commits on Oct 31, 2024

• Remove defaults for job id and start from new sync job

  wajones98

  committed
  aacb15d

  Copy full SHA for aacb15d

• Add job ID to sync job exception message

  wajones98

  committed
  ab9c614

  Copy full SHA for ab9c614

• Add event ID to event processing exception

  wajones98

  committed
  02ace03

  Copy full SHA for 02ace03

• Add reprocess button for failed events

  wajones98

  committed
  0f8e4e9

  Copy full SHA for 0f8e4e9

• Remove TODOs and only sync unique events

  wajones98

  committed
  49b3099

  Copy full SHA for 49b3099

Commits on Nov 1, 2024

• Check resource id in request url

  wajones98

  committed
  137c3d1

  Copy full SHA for 137c3d1

• Add sysadmin check to reprocessing jobs

  wajones98

  committed
  e026453

  Copy full SHA for e026453

Commits on Nov 12, 2024

• Check sysadmin role for plugin endpoints

  wajones98

  committed
  3c15e25

  Copy full SHA for 3c15e25

Commits on Nov 19, 2024

• Update FalkorEvent

  wajones98

  committed
  13c5e63

  Copy full SHA for 13c5e63

• Replace FalkorEventObjectType

  Show description for c3d7a22
  wajones98

  committed
  c3d7a22

  Copy full SHA for c3d7a22

• Update FalkorEvent model and remove get_package_without_create_events func

  wajones98

  committed
  ca5af33

  Copy full SHA for ca5af33

• notify refactor

  Show description for 5556e18
  wajones98

  committed
  5556e18

  Copy full SHA for 5556e18

• remove object_id and type from FalkorEvent in before_show

  wajones98

  committed
  84fe580

  Copy full SHA for 84fe580

• Change instance check to elif

  wajones98

  committed
  dfa394e

  Copy full SHA for dfa394e

• Remove create packages without create events for sync

  wajones98

  committed
  a1ae957

  Copy full SHA for a1ae957

• Refactor client

  Show description for ff53b8e
  wajones98

  committed
  ff53b8e

  Copy full SHA for ff53b8e

• Import HttpError from requests

  wajones98

  committed
  d4e3aff

  Copy full SHA for d4e3aff

• Remove old object type filter from get resources func

  wajones98

  committed
  78ad6f5

  Copy full SHA for 78ad6f5

• get_dictized_entity -> get_dictized_resource

  wajones98

  committed
  ba905e7

  Copy full SHA for ba905e7

• Remove package import from model

  wajones98

  committed
  ffc0398

  Copy full SHA for ffc0398

• New job queue name enum

  wajones98

  committed
  ab01073

  Copy full SHA for ab01073

• Remove Union import from model

  wajones98

  committed
  b69121e

  Copy full SHA for b69121e

• Remove FalkorEventObjectType import

  wajones98

  committed
  9837be8

  Copy full SHA for 9837be8

• Capitalise names for FalkorEventResourceType Enum

  wajones98

  committed
  3b245fd

  Copy full SHA for 3b245fd

• refactor handle to handle_event

  wajones98

  committed
  c468035

  Copy full SHA for c468035

• Remove package_create_event_for_resource

  wajones98

  committed
  49122ff

  Copy full SHA for 49122ff

• Move CONTEXT to model as TOOLKIT_CONTEXT

  wajones98

  committed
  4399449

  Copy full SHA for 4399449

• Rename CONTEXT to TOOLKIT_CONTEXT in plugin

  wajones98

  committed
  c532bb0

  Copy full SHA for c532bb0

• Add create_new_event function

  wajones98

  committed
  70eaee3

  Copy full SHA for 70eaee3

• Simplify event handling

  wajones98

  committed
  5210845

  Copy full SHA for 5210845

• Handle stream resource types

  wajones98

  committed
  0a5a3b5

  Copy full SHA for 0a5a3b5

• Add ckan.model import

  wajones98

  committed
  01a4230

  Copy full SHA for 01a4230

• Fix ResourceType enum for migration

  wajones98

  committed
  8df4c8a

  Copy full SHA for 8df4c8a

• comment out funcs to refactor

  wajones98

  committed
  5b6ee2d

  Copy full SHA for 5b6ee2d

• Fix name for resourceType in migration

  wajones98

  committed
  71aa410

  Copy full SHA for 71aa410

• QUery db directly to avoid recursive calls to "package_show"

  wajones98

  committed
  256090f

  Copy full SHA for 256090f

• Get package and org directly from db

  wajones98

  committed
  9f5bc7d

  Copy full SHA for 9f5bc7d

• Remove debug line for org

  wajones98

  committed
  2f89201

  Copy full SHA for 2f89201

• Fix typo for HTTPError exception

  wajones98

  committed
  c9895cf

  Copy full SHA for c9895cf

• Return result from create_new_event

  wajones98

  committed
  e206f1c

  Copy full SHA for e206f1c

• Add missing status column to FalkorEvent

  wajones98

  committed
  e844f02

  Copy full SHA for e844f02

• Remove commit before setting event status

  wajones98

  committed
  0d08da7

  Copy full SHA for 0d08da7

• formatting

  wajones98

  committed
  f837016

  Copy full SHA for f837016

• Remove queue name for now

  wajones98

  committed
  472773b

  Copy full SHA for 472773b

• formatting

  wajones98

  committed
  3db146a

  Copy full SHA for 3db146a

• convert document events to json

  wajones98

  committed
  3a73989

  Copy full SHA for 3a73989

• parse datetime from string

  wajones98

  committed
  115c306

  Copy full SHA for 115c306

• Fix issues with parsing document body json

  wajones98

  committed
  8361a0c

  Copy full SHA for 8361a0c

Commits on Nov 20, 2024

• Just use datetime.now for updated event

  wajones98

  committed
  9cae957

  Copy full SHA for 9cae957

• Update admin template with new FalkorEvent model

  wajones98

  committed
  2428fe0

  Copy full SHA for 2428fe0

• Make reprocessing single event synchronous

  wajones98

  committed
  f65988b

  Copy full SHA for f65988b

• Reprocess all button

  wajones98

  committed
  f9da529

  Copy full SHA for f9da529

• Reintroduce sync job with latest changes

  wajones98

  committed
  b13132c

  Copy full SHA for b13132c

• Add retries to falkor calls

  wajones98

  committed
  a835535

  Copy full SHA for a835535

• ADd commit to add a "running" sync job

  wajones98

  committed
  69a8b41

  Copy full SHA for 69a8b41

• Remove unused imports

  wajones98

  committed
  81bcd34

  Copy full SHA for 81bcd34

• Remove job queue name

  wajones98

  committed
  673f490

  Copy full SHA for 673f490

• Remove unused code

  wajones98

  committed
  7874cd5

  Copy full SHA for 7874cd5

• Remove outdated TODO

  wajones98

  committed
  06b9d96

  Copy full SHA for 06b9d96

• Remove org id from audit path

  wajones98

  committed
  33deeeb

  Copy full SHA for 33deeeb

• refactor audit url

  wajones98

  committed
  3633e42

  Copy full SHA for 3633e42

• Fix bug with setting resource_id for stream type and add resource type to metadata

  wajones98

  committed
  83b8159

  Copy full SHA for 83b8159

• get raw value from resource type for metadata

  wajones98

  committed
  3df89af

  Copy full SHA for 3df89af

• Handle session from within get_event func

  wajones98

  committed
  6ca5130

  Copy full SHA for 6ca5130

• Use get_events with filter input instead of separate functiosn for each event status

  wajones98

  committed
  e577bfe

  Copy full SHA for e577bfe

• Add tabs for event statuses to falkor admin tab

  wajones98

  committed
  2e99afb

  Copy full SHA for 2e99afb

• Properly construct audit url based off of resource type

  wajones98

  committed
  c33457c

  Copy full SHA for c33457c

• Check event_status query value

  wajones98

  committed
  79565d4

  Copy full SHA for 79565d4

Commits on Nov 21, 2024

• Remove debug log

  wajones98

  committed
  a164dcc

  Copy full SHA for a164dcc

• Rename parameters in falkor client methods

  wajones98

  committed
  9c10c9d

  Copy full SHA for 9c10c9d

• Remove unused func

  wajones98

  committed
  f96f584

  Copy full SHA for f96f584

• Check resource_type is not None

  wajones98

  committed
  a909ab8

  Copy full SHA for a909ab8

• Adjust comment

  wajones98

  committed
  6de11ab

  Copy full SHA for 6de11ab

• Add support for all event statuses to reprocess_all

  wajones98

  committed
  2672d0c

  Copy full SHA for 2672d0c

• Add more logs for debugging

  wajones98

  committed
  034d06c

  Copy full SHA for 034d06c

• Fix url for reprocessing a single event

  wajones98

  committed
  dd024c1

  Copy full SHA for dd024c1