09.09.2019

The problem with data and the decentralised commodity business

It remains a serious issue and has been such for many years. Although many have tried, very few have successfully found a scalable off-the-shelf solution that can manage global data across a decentralised commodity platform.

The commodity business is not uniform in process. There are countless different products and along with them unique aspects of operations in their supply chain. Setting out to standardise a trading, contract entry, operations, risk management, treasury and finance system for a global commodity group is a huge undertaking. There have been countless millions invested in this endeavour and no notable success stories.

Some very well capitalised technology companies can present a fantastic vision for this infrastructure and they have good sales teams but caveat emptor, once you enter into one of their development agreements, you are actually agreeing to build a platform yourself with the help of their business analysts and developers. Unless you are careful and have excellent project management and internal engagement, what you will obtain, in various guises, is a system completely different from that which was showcased at the sales presentation. Invoices will pile up , the budget requests get enormous, the staff become skeptical and disengaged and the politics get extremely sticky. Eventually somebody may be held responsible for wasting a lot of company money and what is left in place may be less efficient than the legacy process which you were attempting to replace. I am not claiming this will always be the case but it has happened rather a lot. 

So, is there a solution? 

I believe there is and it begins with being practical and keeping it simple.

Let’s first consider why commodity businesses require this sort of data consolidation in the first place. 
There was a time, I think even so little as fifteen years ago, when having operations all around the globe with a physical presence in the countries of product origin and destination produced a distinct market advantage. All it took were daily mails from each location to update on what was happening locally to give the central trading desks enough information to find an edge in their positioning. These were the days of brash traders walking into the office feeling bullish and buying a ’shed load’ on the open and if the market didn’t respond, buying a ’shed load’ more until it did. I was working at Cargill in the mid 90’s and we had a green screen wire system. There were days when I would come into the office to look at the soybean book and open up the wires to read comments from the midwest like, “I am so bullish today, I have already grown horns”. It was a slam dunk, just hit the buy on open and in came the money. 

Today, this general market information is available to everybody, the advantage is gone and with it, the trading edge it provided. Today more analysis is required to better understand what is really happening globally on the buy and sell side of a market and also to fully understand the open risk position which a business is exposed to globally and so find the smartest way to hedge or leverage that. Commodity businesses are running large volumes with thin margins and need to have good control over their staff compliance, operational excellence, quality control, working capital allocation, fx exposure and credit exposure. The profit on a bulk cargo can be easily destroyed by poor operation, quality issues  or logistics. Mistakes in fx hedging can lead to big unexpected mark downs when converted to reporting currency and non-compliant behaviour can lead not only to large losses, nearly all the largest hits are due to rogue trader activity, but also fines from regulatory bodies and long term reputation damage.

You can implement all the brilliant analytical tools, smart data science teams, finance gurus and expert risk analysts you want but these will not make much of a difference unless you have control of your data. Data is where the value is today and managing data is the key to the future leaders of the commodity industry. There will be disruption, there is a gaping hole through which data smart, well capitalised and ambitious businesses can thrive.

So back to the question of data management. If you already have a decentralised infrastructure and have allowed operational companies to grow up as separate business units, manage their own process, policies, data systems, finance and risk and today you find that at group level the transparency is less than desirable and you have a strong feeling that competitive advantage could be much improved with a better view of the global picture. Start here. 

In each location first map out what the data looks like, what systems are being used and how is that data stored and updated. This could be anything from a monthly consolidated spreadsheet to a disciplined, structured transactional database.

Work out what you need to know about each transaction at group level in order to centralise functions and analysis. This can be achieved by speaking with risk teams, treasury teams, accounting, controlling, operations and front office. Follow a few transactions of different kinds through from initiation to financial reporting and see what fields are relevant in order to know everything about a transaction. 
Once you know the fields you require, then look at the hierarchies. What master groups are there and what subgroups do they divide into. For example under ‘commodities’ you may have ‘grains’ which then subdivides into ‘corn’, ‘wheat’, ’sorghum’,'oats’ and then each of those would divide further into type, location or quality. The structure will depend on how the business operates but it must consider not only the commodity hierarchy but also how limits are to be allocated and sub-divided or how working capital allocation is to be measured. 
It is an important consideration and time should be taken to get it right as once populated, this will be the basis on which you store and reference your global data. 

You need to work out how you can obtain what you have going on around the globe every day and fit it into what you have created at a central level. Some companies will claim that you need to have this huge ambition and create a standard global install of an all singing and dancing solution but I would warn against that unless you want an incredibly long and painful death. There are solution providers out there which have excellent components to help in this process and rather than trying to offer a complete solution they offer component parts. The best of these companies have a deep knowledge of the commodity business and have employed analysts and technical people with significant industry experience. I will gladly advise on some of these options. 

The fast and effective way to tackle the problem is to send a data team, ideally people who understand or worked on the initial database structure, to each location in sequence and work out what is there, how they can access it in an automated fashion daily and what transformations need to occur to that data in order that it can be standardised for the new central database format. 

In each location a transformation layer needs to deal with field conversion, this could be as simple as calling something ‘quantity’ in one place and ‘lots’ in another. After transformation everything has to be equivalent in label, in SI unit and in currency denomination…..

To be continued in part 2:

Admin - 13:28 | 13 comments

  1. Delta10

    15.06.2021

    I really loved reading your blog. It was very well authored and easy to undertand. Unlike additional blogs I have read which are really not tht good. I also found your posts very interesting. In fact after reading, I had to go show it to my friend and he ejoyed it as well!

  2. wedding videographer near me

    15.09.2021

    Thank you so much for the post you do. I like your post and all you share with us is up to date and quite informative, i would like to bookmark the page so i can come here again to read you, as you have done a wonderful job.

  3. thanks

    29.03.2022

    Nihil voluptatem et

  4. awkwardmedia

    19.05.2022

    Anyway, it may not generally be important to have your whole site interpreted. Maybe an extensive interpretation of one of your pages can likewise be utilized to enter your site into the web search tool catalogs of your objective area. This will permit you to get better rankings on relating web indexes.

  5. cute anime boyfriend

    19.05.2022

    Most fitness specialists will let you know that health and fitness supplements for ladies are not prudent. In addition to the fact that they are not resolving the issues or propensities that have caused weight or health issues, however, they might be adding to the issues simultaneously.

  6. houses for sale

    24.06.2022

    While posting dispossessed houses available to be purchased on the web there are numerous things that you want to believe to be certain that you draw in whatever number individuals as would be prudent. Be certain you utilize something like date photographs, give precise data, and have a completely utilitarian site. These three things will assist you with building believability and ideally sell the house.

  7. customized pens bulk

    14.09.2022

    For workplaces particularly, it is dependably a more practical plan to buy discount pens instead of get them exclusively. On the off chance that the object is to buy discount pens for office supply or limited time use, one method for doing this is through unique Internet offers which accord truly extraordinary limits. The Internet has an endless decision prospects and the best choice of aspects, tints and customized other options. Pick a web-based retailer which is knowledgeable about special or support pens, for example, pensxpress.com or pensrus.com.

  8. Tesla Software

    20.09.2022

    One of the most famous stages for web content administration utilized by government, higher instructive establishments, worldwide undertakings, and non-government associations, Drupal powers around 5.7% of worldwide sites, right from individual online journals to political, corporate, and government sites including the White House, Tesla Engines, The Financial specialist, Pfizer, Harvard College, the Public authority of Australia, and Time Inc.

  9. Gérance Immobilière Valais

    22.09.2022

    En plus de participer aux magnifiques délices d’une résidence secondaire sur la Côte d’Azur, posséder votre propre domaine extravagant constitue l’une des aventures spéculatives les plus intéressantes. Lieux, par exemple, Saint Tropez,

  10. pop culture collectibles toys

    28.09.2022

    Young ladies will continuously invite play with a definitive exemplary kids’ toy, a doll or assortment of dolls. With a huge swath of dolls, going in size from handheld to a greater amount of a baby estimated presenting alongside going with embellishment product offerings, guardians and gift-providers the same will invite the presence of a doll in their youngster’s life.

  11. skincare clinic near me

    12.10.2022

    For example, botox is short for two words: botulinum toxin, which comes from the bacteria Clostridium botulinum. This is the same toxin that is known to cause the fatal food poisoning known as botulism. Cosmetic Botox is a brand name owned by Allergan and is the only drug of its type approved by the United States Food and Drug Administration (FDA) for the treatment of wrinkles.

  12. wietzaden buiten

    12.10.2022

    Hoe werkt CBD? De groep mensen bevat een enorme organisatie van samenstellende receptoren, de rangschikking van endocannabinoïden , die essentieel is om gelijke tred te houden met het algemene welzijn, naast het helpen van de emotioneel ondersteunende netwerken voor de overgrote meerderheid van de feitelijke cycli in ons lichaam. Cannabinoïden en CBD passen in deze receptoren die het menselijk lichaam helpen bij zijn inspanningen om een groot welzijn bij te houden.

  13. dating profile

    02.12.2022

    I know this sounds senseless, however work on grinning in the mirror. Most times individuals could do without their own grin or photos of themselves, yet we as a whole view ourselves uniquely in contrast to another person would. Have you at any point saw somebody who’s gorgeous and they are grinning? You get an extremely warm inclination. Well this is what you need to give others.

Add comment

Fill out the form below to add your own comments

Om geautomatiseerde spam zoveel mogelijk te beperken, is deze functie beveiligd met een captcha.

Hiervoor moet inhoud van de externe dienstverlener Google worden geladen en moeten cookies worden opgeslagen.