API Quality is more than meets the eye API Quality is more than meets the eye API Quality is more than meets the eye

API Quality is more than meets the eye

Benny Boye Johansen

Head of OpenAPI, Saxo Bank

As Saxo is working to create the vision for our next version of OpenAPI, we are looking for many sources of inspiration as to what needs to get improved. One initiative is a collaboration with the Department of Digitalization at Copenhagen Business School with the purpose to assess API quality and how different ways of working, different design methodologies, and different forms of governance may affect delivery speed and API quality.While the project is just getting started, it has already provided me with a first "aha" moment, or insight as you may say.

One of the first activities was to gauge the current quality of our OpenAPI. Instead of just relying on our own gut feeling about what may constitute a “good” API, the CBS team wanted to derive a more objective measure. Being quite thorough and academic, they scoured a long list of 59 resources, including developer blogs, academic articles, and vendor material to identify attributes which were mentioned as important to API quality. They subsequently grouped these into categories, themes, and indicators, and presented these to a number of OpenAPI front-runner companies, such as Saxo for feedback and refinement.

Their findings will later be published and detailed in a CBS working paper, but I have been allowed to provide a small overview/summary.

OpenAPI Quality Indicators

The table below summarises CBS’ early findings. All stated measures are divided into two broad categories (Product attributes and Process Attributes). Each category comprises several themes (Documentation, Security etc.), each of which then includes a number of quality indicators, the number of which are included is indicated in brackets.

 Product AttributesProcess Attributes 
 Documentation (3):

Is the documentation correct, comprehensive, etc.?

API Inventory (3):
Are there processes and tools in place to support proper inventorying of the API landscape?

Security (6):

Are security requirements satisfied?

Guides and Policies (4):
Are there design guides and testing guides and are they followed?

Design Conformity (14):

Does the API conform to internal standards, and “best practices”?

Internal Tooling (4):
Is there tooling to aid design, ensure conformity and adherence?

REST API (3):

Does the API conform to common REST design patterns?

Testing (13):
Is adequate testing done at relevant stages in the development process?

Scalable (9):

Is the API scalable and is performance monitored?

API Governance (7):
How is the API development governed and aligned with company strategy?

Metrics (15):

Are relevant technical and commercial metrics readily available?

Approach (8):
API First, Code-First and integration into the general s/w development lifecycle. Does the chosen approach match with expected outcome?

Standard software components (4):

Does the offering include a developer portal, an API Gateway etc.?

Development Process (9):
Are common best practices for s/w development followed?

Industry Standards Adherence (5):
If relevant, does the API conform to established industry standards?
 

So how good is your API really?

The interesting part – for me at least – was that on a day-to-day basis my team of OpenAPI Platform managers primarily worry about a small subset of the comprehensive list, and mostly about the attributes on the left in the table.

We constantly ask ourselves:

  • Does our API follow the agreed design principles, is it “fit for purpose”, is there consistency within and across domains?
  • Is the API stable, performant etc?
  • Do we have sufficient documentation, sample code, and support in our demo environments?

But what about all the other stuff? Why are we not thinking about that, and why would we not have come up with these measures, if you had asked any of us how we would assess API quality?

Perhaps it has to do with the "Four Levels of Competence" model, first developed by Noel Buch in the 1970s, which states that in almost all learning we go through four levels, as shown in the table below:

 Competency levelsWhat it means 
Unconscious incompetenceWe are really poor at something, and we don’t even know it, so we don’t do anything to address it. 
Conscious incompetenceWe are poor at something, and we know that we have to improve. 
Conscious competenceWe understand how to do something (well), but it still requires effort. 
Unconscious competenceWe are so competent in this area, that it is second nature and can be performed easily. 
Source: https://en.wikipedia.org/wiki/Four_stages_of_competence


Note that according to this, we will have a blind spot to what we are really poor at (unconscious incompetence) but also what we are really good at (unconscious competence).

This reminds me of a job interview I had a long time ago. The interview went quite well until we got to the stereotypical question of “so what are you good at”? I remember giving a passionate description of a problem I had recently solved (to my own great satisfaction), and I was pretty happy with that answer until a colleague praised me for something, which I actually thought was super easy and did not think much of. I then realised that my answer at the job interview probably was not my real strength – it was just what I was conscious about at the time, and in this case consciously competent at.

Time for an API 360?

The comprehensive and somewhat academic and theoretical work eventually published by CBS is an important reminder for both developers and consumers of OpenAPIs.

It is very natural for a team like mine to sometimes have a too narrow focus. It is easy for any engineering team to be too much “inside out” rather than “outside in” and forget what matters most for our clients. As discussed above, we are by default also limited to focus on what we are conscious about.

For us, a checklist like the above (even in its skeleton form) is a good reminder to consider all of the indicators of good API design and good API development practices.

The same goes for potential OpenAPI consumers, such as our partners. It is quite tempting to only assess the product you can see directly on our OpenAPI developer portal. “Do they have an API for this, does it appear to be well documented, do they have available samples etc?” But they are probably well advised to also consider some of the more invisible qualities: “Have they got adequate security measures in place”, “Do they have proper software development and testing practices”, “Is the underlying system scalable” etc.

In summary, developing and managing a comprehensive OpenAPI supporting hundreds of partners and millions of trades from over 180 countries is a multifaceted challenge. To be successful, both as providers and consumers  one must consider many factors and remember that there is more than meets the eye when it comes to a true assessment of OpenAPI quality.

Disclaimer

Saxo Capital Markets (Australia) Limited prepares and distributes information/research produced within the Saxo Bank Group for informational purposes only. In addition to the disclaimer below, if any general advice is provided, such advice does not take into account your individual objectives, financial situation or needs. You should consider the appropriateness of trading any financial instrument as trading can result in losses that exceed your initial investment. Please refer to our Analysis Disclaimer, and our Financial Services Guide and Product Disclosure Statement. All legal documentation and disclaimers can be found at https://www.home.saxo/en-au/legal/.

The Saxo Bank Group entities each provide execution-only service. Access and use of Saxo News & Research and any Saxo Bank Group website are subject to (i) the Terms of Use; (ii) the full Disclaimer; and (iii) the Risk Warning in addition (where relevant) to the terms governing the use of the website of a member of the Saxo Bank Group.

Saxo News & Research is provided for informational purposes, does not contain (and should not be construed as containing) financial, investment, tax or trading advice or advice of any sort offered, recommended or endorsed by Saxo Bank Group and should not be construed as a record of our trading prices, or as an offer, incentive or solicitation for the subscription, sale or purchase in any financial instrument. No representation or warranty is given as to the accuracy or completeness of this information. All trading or investments you make must be pursuant to your own unprompted and informed self-directed decision. No Saxo Bank Group entity shall be liable for any losses that you may sustain as a result of any investment decision made in reliance on information on Saxo News & Research.

To the extent that any content is construed as investment research, such content was not intended to and has not been prepared in accordance with legal requirements designed to promote the independence of investment research and as such, would be considered as a marketing communication.

None of the information contained here constitutes an offer to purchase or sell a financial instrument, or to make any investments.Saxo Capital Markets does not take into account your personal investment objectives or financial situation and makes no representation and assumes no liability as to the accuracy or completeness of the information nor for any loss arising from any investment made in reliance of this presentation. Any opinions made are subject to change and may be personal to the author. These may not necessarily reflect the opinion of Saxo Capital Markets or its affiliates.

Please read our disclaimers:
- Full Disclaimer (https://www.home.saxo/en-au/legal/disclaimer/saxo-disclaimer)
- Analysis Disclaimer (https://www.home.saxo/en-au/legal/analysis-disclaimer/saxo-analysis-disclaimer)
- Notification on Non-Independent Investment Research (https://www.home.saxo/legal/niird/notification)

Saxo Capital Markets (Australia) Limited
Suite 1, Level 14, 9 Castlereagh St
Sydney NSW 2000
Australia

Contact Saxo

Select region

Australia
Australia

The Saxo trading platform has received numerous awards and recognition. For details of these awards and information on awards visit www.home.saxo/en-au/about-us/awards

Saxo Capital Markets (Australia) Limited ABN 32 110 128 286 AFSL 280372 (‘Saxo’ or ‘Saxo Capital Markets’) is a wholly owned subsidiary of Saxo Bank A/S, headquartered in Denmark. Please refer to our General Business Terms, Financial Services Guide, Product Disclosure Statement and Target Market Determination to consider whether acquiring or continuing to hold financial products is suitable for you, prior to opening an account and investing in a financial product.

Trading in financial instruments carries various risks, and is not suitable for all investors. Please seek expert advice, and always ensure that you fully understand these risks before trading. Saxo Capital Markets does not provide ‘personal’ financial product advice, any information available on this website is ‘general’ in nature and for informational purposes only. Saxo Capital Markets does not take into account an individual’s needs, objectives or financial situation. The Target Market Determination should assist you in determining whether any of the products or services we offer are likely to be consistent with your objectives, financial situation and needs.

Apple, iPad and iPhone are trademarks of Apple Inc., registered in the US and other countries. AppStore is a service mark of Apple Inc.

The information or the products and services referred to on this website may be accessed worldwide, however is only intended for distribution to and use by recipients located in countries where such use does not constitute a violation of applicable legislation or regulations. Products and Services offered on this website is not intended for residents of the United States and Japan.

Please click here to view our full disclaimer.