fmrest-ruby

A Ruby client for FileMaker's Data API with ActiveRecord-ish ORM features.

While pretty feature-rich, fmrest-ruby doesn't yet support 100% of FileMaker 19's Data API features. See the implementation completeness table to check if a feature you need is natively supported by the gem.

Need Ruby or FileMaker consulting? Contact us at Beezwax.net

Gems

The fmrest gem is a wrapper for these gems:

• fmrest-spyke, providing an ActiveRecord-like ORM library built on top of fmrest-core and Spyke.
• fmrest-core, providing the core Faraday connection builder, session management, and other core utilities.
• fmrest-rails, providing Rails integration.

In addition, the optional fmrest-cloud gem adds support for FileMaker Cloud. See the main document on connecting to FileMaker Cloud.

Installation

In your Gemfile:

gem 'fmrest'

# Optional: if your files are hosted on FileMaker Cloud
gem 'fmrest-cloud'

If you're using Rails you can now run:

rails generate fmrest:config

Simple example

# A Layout model connecting to the "Honeybees Web" FileMaker layout
class Honeybee < FmRest::Layout("Honeybees Web")
  # Connection settings
  self.fmrest_config = {
    host:     "…",
    database: "…",
    username: "…",
    password: "…"
  }

  # Mapped attributes
  attributes name: "Bee Name", age: "Bee Age", created_on: "Created On"

  # Portal associations
  has_portal :tasks

  # File containers
  container :photo, field_name: "Bee Photo"

  # Scopes
  scope :can_legally_fly, -> { query(age: ">18") }

  # Client-side validations
  validates :name, presence: true

  # Callbacks
  before_save :set_created_on

  private

  def set_created_on
    self.created_on = Date.today
  end
end

# Find a record by id
bee = Honeybee.find(9)

bee.name = "Hutch"

# Add a new record to portal
bee.tasks.build(urgency: "Today")

bee.save

In case you don't want the ORM features (i.e. you only need authentication and JSON parsing, and are comfortable writing the API requests manually without the ORM overhead) you can use the Faraday connection provided by fmrest-core. See the main document on using the base connection for more.

Connection settings

The minimum required connection settings are :host, :database, :username and :password, but fmrest-ruby has many other options you can pass when setting up a connection (see full list below).

:ssl and :proxy are forwarded to the underlying Faraday connection. You can use this to, for instance, disable SSL verification:

{
  host: "…",
  …
  ssl:  { verify: false },
  proxy: "http://user:password@proxy.host:4321"
}

You can also pass a :log option for basic request logging, see the section on Logging below.

Full list of available options

Option	Description	Format	Default
:host	Hostname with optional port, e.g. example.com:9000	String	None
:database	The name of the database to connect to	String	None
:username	A Data API-ready account	String	None
:password	Your password	String	None
:account_name	Alias of :username	String	None
:ssl	SSL options to be forwarded to Faraday	Faraday SSL options hash	None
:proxy	Proxy URI, e.g. http://user:password@proxy.host:4321	String	None
:log	Log JSON responses to STDOUT	Boolean	false
:log_level	Which log level to log into	Values accepted by Logger#level=	:debug
:coerce_dates	See section on date fields	Boolean \	:hybrid \
:date_format	Date parsing format	String (FM date format)	"MM/dd/yyyy"
:timestamp_format	Timestmap parsing format	String (FM date format)	"MM/dd/yyyy HH:mm:ss"
:time_format	Time parsing format	String (FM date format)	"HH:mm:ss"
:timezone	The timezone for the FM server	:local \	:utc \
:autologin	Whether to automatically start Data API sessions	Boolean	true
:token	Used to manually provide a session token (e.g. if :autologin is false)	String	None
:fmid_token	Claris ID token (only needed if manually obtaining the token)	String	None
:cloud	Specifies whether the host is using FileMaker Cloud	:auto \	Boolean
:cognito_client_id	Overwrites the hardcoded FileMaker Cloud Cognito Client ID	String	None
:cognito_pool_id	Overwrites the hardcoded FileMaker Cloud Cognito Pool ID	String	None
:aws_region	Overwrites the hardcoded FileMaker Cloud AWS Region	String	None

Default connection settings

If you're only connecting to a single FM database you can configure it globally through FmRest.default_connection_settings=. E.g.:

FmRest.default_connection_settings = {
  host:     "…",
  database: "…",
  username: "…",
  password: "…"
}

These settings will be used by default by FmRest::Layout models whenever you don't set fmrest_config= explicitly, as well as by FmRest::V1.build_connection in case you're setting up your Faraday connection manually.

Session token store

fmrest-ruby includes a number of options for storing session tokens:

• Memory
• ActiveRecord
• Redis
• Moneta

See the main document on token stores for detailed info on how to set up each store.

Date fields and timezones

fmrest-ruby has automatic detection and coercion of date fields to and from Ruby date/time objects. Basic timezone support is also provided.

See the main document on date fields for more info.

ActiveRecord-like ORM (fmrest-spyke)

Spyke is an ActiveRecord-like gem for building REST ORM models. fmrest-ruby uses it to build its ORM features, bundled in the fmrest-spyke gem (already included if you're using the fmrest gem).

To create a model you can inherit directly from FmRest::Layout (itself a subclass of Spyke::Base).

class Honeybee < FmRest::Layout
end

All of Spyke's basic ORM operations work as expected:

bee = Honeybee.new

bee.name = "Hutch"
bee.save # POST request (creates new record)

bee.name = "ハッチ"
bee.save # PATCH request (updates existing record)

bee.reload # GET request

bee.destroy # DELETE request

bee = Honeybee.find(9) # GET request

It's recommended that you read Spyke's documentation for more information on these basic features. If you've used ActiveRecord or similar ORM libraries you'll find it quite familiar.

Notice that FmRest::Layout is aliased as FmRest::Spyke::Base. Previous versions of fmrest-ruby only provided the latter version, so if you're already using FmRest::Spyke::Base there's no need to rename your classes to FmRest::Layout, both will continue to work interchangeably.

In addition, FmRest::Layout extends Spyke::Base with the following features:

FmRest::Layout.fmrest_config=

This allows you to set Data API connection settings specific to your model class:

class Honeybee < FmRest::Layout
  self.fmrest_config = {
    host:     "…",
    database: "…",
    username: "…",
    password: "…"
  }
end

These settings are class-inheritable, so you could create a base class that does the initial connection setup and then inherit from it in models using that same connection. E.g.:

class ApplicationFmLayout < FmRest::Layout
  self.fmrest_config = { host: "…", database: "…", … }
end

class Honeybee < ApplicationFmLayout
  # This model will use the same connection as ApplicationFmLayout
end

If fmrest_config is not set, your model will try to use FmRest.default_connection_settings instead.

Connection settings overlays

There may be cases where you want to use a different set of connection settings depending on context. For example, if you want to use username and password provided by the user in a web application. Since .fmrest_config is set at the class level, changing the username/password for the model in one context would also change it in all other contexts, leading to security issues.

To solve this scenario, fmrest-ruby provides a way of defining thread-local, reversible connection settings overlays through .fmrest_config_overlay=.

See the main document on connection setting overlays for details on how it works.

FmRest::Layout.layout

Use layout to set the layout name for your model.

class Honeybee < FmRest::Layout
  layout "Honeybees Web"
end

Alternatively, if you're inheriting from FmRest::Layout directly you can set the layout name in the class definition line:

class Honeybee < FmRest::Layout("Honeybees Web")

Note that you only need to manually set the layout name if the name of the class and the name of the layout differ, otherwise fmrest-ruby will just use the name of the class.

FmRest::Layout.request_auth_token

Requests a Data API session token using the connection settings in fmrest_config and returns it if successful, otherwise returns false.

You normally don't need to use this method as fmrest-ruby will automatically request and store session tokens for you (provided that :autologin is true in the connection settings, which it is by default).

FmRest::Layout.logout

Use .logout to log out from the database session (you may call it on any model that uses the database session you want to log out from).

Honeybee.logout

Mapped FmRest::Layout.attributes

Spyke allows you to define your model's attributes using attributes, however sometimes FileMaker's field names aren't very Ruby-ORM-friendly, especially since they may sometimes contain spaces and other special characters, so fmrest-ruby extends attributes' functionality to allow you to map Ruby-friendly attribute names to FileMaker field names. E.g.:

class Honeybee < FmRest::Layout
  attributes first_name: "First Name", last_name: "Last Name"
end

You can then simply use the pretty attribute names whenever working with your model and they will get mapped to their FileMaker fields:

bee = Honeybee.find(1)

bee.first_name # => "Princess"
bee.last_name  # => "Buzz"

bee.first_name = "Queen"

bee.attributes # => { "First Name": "Queen", "Last Name": "Buzz" }

FmRest::Layout.has_portal

You can define portal associations on your model wth has_portal, as such:

class Honeybee < FmRest::Layout
  has_portal :flowers
end

class Flower < FmRest::Layout
  attributes :color, :species
end

See the main document on portal associations for details.

Dirty attributes

fmrest-ruby includes support for ActiveModel's Dirty mixin out of the box, providing methods like:

bee = Honeybee.new

bee.changed? # => false

bee.name = "Maya"

bee.changed? # => true

bee.name_changed? # => true

fmrest-ruby uses the Dirty functionality to only send changed attributes back to the server on save.

You can read more about ActiveModel's Dirty in Rails Guides.

Query API

Since Spyke is API-agnostic it only provides a wide-purpose .where method for passing arbitrary parameters to the REST backend. fmrest-ruby however is well aware of its backend API, so it extends Spkye models with a bunch of useful querying methods: .query, .match, .omit, .limit, .offset, .sort, .portal, .script, etc.

See the main document on querying for detailed information on the query API methods.

Finding records in batches

Sometimes you want to iterate over a very large number of records to do some processing, but requesting them all at once would result in one huge request to the Data API, and loading too many records in memory all at once.

To mitigate this problem you can use .find_in_batches and .find_each.

See the main document on finding in batches for detailed information on how those work.

Container fields

You can define container fields on your model class with container:

class Honeybee < FmRest::Layout
  container :photo, field_name: "Beehive Photo ID"
end

See the main document on container fields for details on how to use it.

Script execution

The FM Data API allows running scripts as part of many types of requests, and fmrest-spyke provides mechanisms for all of them.

See the main document on script execution for details.

Setting global field values

You can call .set_globals on any FmRest::Layout model to set global field values on the database that model is configured for.

See the main document on setting global field values for details.

Rescuable mixin

Sometimes you may want to handle Data API errors at the model level. For such cases fmrest-ruby provides an off-by-default mixin called Rescuable that provides convenience macros for that. If you've used Ruby on Rails you may be familiar with its syntax from controllers. E.g.

class BeeBase < FmRest::Layout
  include FmRest::Spyke::Model::Rescuable

  rescue_from FmRest::APIError::SystemError, with: :notify_admin_of_system_error

  def self.notify_admin_of_system_error(e)
    # Shoot an email to the FM admin...
  end
end

Since Rescuable uses ActiveSupport::Rescuable internally, you may want to check Rails' documentation too for details on how it works.

One caveat of using rescue_from is that it always catches exceptions at the class level, so if you pass a method name to with: that method has to be a class method. Also note that this will only catch exceptions raised during an API call to the Data API server (in other words, only on actions that perform an HTTP request).

Optional modId

The Data API provides an optional modId value that gets set on a record every time you fetch or update it. This value then gets included in the API request when you save the record, and FileMaker compares it against the current value, preventing the update in case of a mismatch.

This safety feature is enabled by default in fmrest-spyke models, but you can disable it using the inheritable ignore_mod_id flag on your model classes or instances. E.g.

class Bee < FmRest::Layout
  # This disables modId for all instances and subclasses
  self.ignore_mod_id = true
end

# Or set it on instances:
bee = Bee.new
bee.ignore_mod_id # => true (set in class)
bee.ignore_mod_id = false # (affects only this instance)

You can also set it directly on FmRest::Layout if you want to disable it for your entire app:

FmRest::Layout.ignore_mod_id = true

Logging

If using fmrest-spyke with Rails then pretty log output will be set up for you automatically by Spyke (see their README).

You can also enable simple Faraday logging of raw requests (useful for debugging) by passing log: true in the options hash for either FmRest.default_connection_settings= or your models' fmrest_config=, e.g.:

FmRest.default_connection_settings = {
  host: "…",
  …
  log:  true
}

# Or in your model
class LoggyBee < FmRest::Layout
  self.fmrest_config = {
    host: "…",
    …
    log:  true
  }
end

You can also pass log_level to connection settings to change the severity of log output (defaults to :debug).

By default fmrest-ruby logs to STDOUT or to Rails' logger object if available. You can change this by providing your own logger object to FmRest.logger=:

FmRest.logger = Logger.new("fmrest.log")

If you need to set up more complex logging for your models you can use the faraday block inside your class to inject your own logger middleware into the Faraday connection, e.g.:

class LoggyBee < FmRest::Layout
  faraday do |conn|
    conn.response :logger, MyApp.logger, bodies: true
  end
end

Gotchas

Read about unexpected scenarios in the gotchas doc.

API implementation completeness table

FM Data API reference: https://help.claris.com/en/data-api-guide/

FM 19 Data API feature	Supported by basic connection	Supported by FmRest::Layout
Log in using HTTP Basic Auth	Yes	Yes
Log in using OAuth	No	No
Log in to an external data source	No	No
Log in using Claris ID account (FileMaker Cloud)	Yes	Yes
Log out	Yes	Yes
Get product information	Manual*	No
Get database names	Manual*	No
Get script names	Manual*	No
Get layout names	Manual*	No
Get layout metadata	Manual*	No
Create a record	Manual*	Yes
Edit a record	Manual*	Yes
Duplicate a record	Manual*	No
Delete a record	Manual*	Yes
Edit portal records	Manual*	Yes
Get a single record	Manual*	Yes
Get a range of records	Manual*	Yes
Get container data	Manual*	Yes
Upload container data	Manual*	Yes
Perform a find request	Manual*	Yes
Set global field values	Manual*	Yes
Run a script	Manual*	Yes
Run a script with another request	Manual*	Yes

* You can manually supply the URL and JSON to a FmRest connection.

Supported Ruby and Rails versions

The latest fmrest-ruby is tested against Ruby 3.0 through 3.3, and Rails (ActiveSupport) 6.1 through 7.1.

Gem development

After checking out the repo, run bin/setup to install dependencies. Then, run bundle exec rspec to run the specs. You can also run bin/console for an interactive prompt that will allow you to experiment (it will auto-load all fixtures in spec/fixtures).

To install all gems onto your local machine, run bundle exec rake all:install. To release a new version, update the version number in lib/fmrest/version.rb, and then run bundle exec rake all:release, which will create a git tag for the version, push git commits and tags, and push the .gem files to rubygems.org.

Disclaimer

This project is not sponsored by or otherwise affiliated with Claris International Inc., an Apple Inc. subsidiary. FileMaker is a trademark of Claris International Inc., registered in the U.S. and other countries.