Type Safety Everywhere & The Pipeline Grows

Week 6

#PostgreSDK

A landmark week, shipping nine releases (v0.17.0 through v0.18.10) with a focus on TypeScript type safety and developer ergonomics.

  • Select/exclude field filtering on all CRUD operations, include methods, and JSONB tables—with full TypeScript overloads so return types narrow automatically based on what you select
  • Automatic type inference for included relations means nested includes now carry proper TypeScript types all the way through
  • Code generator now detects file-level changes and skips unnecessary regeneration with version-based cache invalidation
  • Fixed nested include parameter resolution to use the correct target table's spec
  • Fixed pair combination method generation for tables with 4–6 relationships

#Inspiration Index

  • Scraper grew significantly—five new sources bringing the total to nine
  • Domain URL limits and import deduplication prevent runaway crawls and redundant data
  • Parallel page discovery with database-level conflict resolution improves throughput
  • Round-robin website selection for balanced recorder submissions
  • URL normalization, metadata sanitization, and expanded page type taxonomy
  • SNS state-change alerts with Terraform IaC for operational visibility
  • Tech stack detection landed as a new field—pages are now analyzed for the technologies they use
  • Pipeline migrated to a normalized technology storage schema with type-safe SDK includes
  • AI classification improved with better examples and a model upgrade
  • Taxonomy color delimiters updated for more reliable parsing; schema cleaned up with DB SDK regenerated
  • App shipped a feedback system with save buttons, navigation improvements, and path-based device routing
  • Optimized API payloads using new field selection; extracted saved item Zod schemas to a shared directory

#Autoscroll Recorder

  • Custom tech detection replaces the third-party Wappalyzer library, with a new detectTechnologies API param
  • Switched to Ghostery adblocker for more reliable cookie and ad blocking
  • Persistent Chrome profile replaces dynamic locale detection for more consistent browser behavior
  • Deterministic S3 keys replace date-partitioned keys for simpler asset management
  • Navigation errors excluded from browser crash detection to reduce false positives
  • ECS task event capture added for operational observability
  • Role-based access control with admin user support
  • Device selection added to the job creation API
  • Bulk job retry API endpoint for operational recovery
  • Waitlist system with improved retry distribution handling

#Silo CDP

  • Bot detection system launched with user agent analysis, UBID tracking, and iOS browser support
  • Team membership enrichment and UBID enrichment systems added for improved visitor identity tracking
  • Bot enrichment optimized with bulk SQL updates and idempotent team enrichment with corrected property field names

#Formgen

Rating matrix export now expands fields into individual columns for better spreadsheet usability. Excel export fallback fixed for nested data structures.