Zero Knowledge

And you thought magic was not real

“Zero Knowledge”, contrary to what it sounds like, is actually quite interesting and fun. It might even be a solution to our long standing problem of validating the world’s transactions without a trusted third party or government or central bank. If you Google for the terms Zero Knowledge and Blockchains, you will be flooded with whitepapers, articles, explainers, investment advice, and everything in between.

What does Zero Knowledge (ZK) even mean? Let me start with a toy example, and then we can work our way up to world peace.

Say we both get the same newspaper and it has a Sudoku puzzle in the games page. I claim to you that I know the solution to this puzzle, but will not tell you what the solution is. Being the frenemy that you are, you won’t believe me, obviously. Can I prove it to you, beyond reasonable doubt, that I do know the solution to this Sudoku puzzle, without telling you what the solution is? More formally,

  • If I know a solution, I should be able to convince you of that. Without leaking any knowledge about the solution.

  • If I lie about knowing the solution, I should be caught – with overwhelming probability.

If both the above are possible, that would be a Zero Knowledge Proof of Knowledge of a Sudoku puzzle. There are some ingenious ways of doing this, which rely heavily on cryptographic primitives and protocol design. In fact, it’s possible to convince an audience that you know the solution for almost any puzzle without giving them any hint of the solution itself. Sudoku was just one example. You could prove that you know the solution to a crossword puzzle, or the Rubick’s cube, or that you know a cycling route from New York to Seattle that’s exactly 5000km, or that you have paid your rent, or that your bank balance is more than $10,000 or any such statement really – without actually revealing the actual solution to the statement.

Imagine the power of such a system, where you could convince others that something is true, without revealing how it is true. In most real world systems, including financial systems, to prove something to someone, you have to reveal the actual facts of the matter – and thereby reveal more than you have to.

For example, getting a visa to any country requires you to provide your bank statement – just to prove that you can afford the trip. It should be possible to prove that you can afford the trip, without revealing any financial information. Also, the proof should be real – as in, if you cannot afford the trip, you shouldn’t be able to prove such a thing and fool the visa-issuing agency. We want both sides, the prover and the verifier, to win. Just with no leak of extra information. The best kind of privacy, if you will.

Where is Waldo?

First, I will give an example of how such a Zero Knowledge protocol looks like, to make you believe that it’s possible. Below is Waldo: Say Hi to him.

Waldo is somewhere in the amusement park image below. Can you find him? Don’t try too hard, it’s not worth it.

This “Where is Waldo” puzzle lends itself very well to a Zero Knowledge protocol. I can prove it to you that I know where Waldo is without revealing his actual location on the image. How do I do that? We run the following protocol between the two of us.

  1. You blindfold yourself. I keep a large white sheet of paper on top of the amusement park image, and ask you to remove your blindfold. You can give me one of two challenges. You should choose these challenges randomly.

    1. Remove the sheet of paper and show you the amusement park image underneath.

    2. Cut out a small hole in the white paper right above where Waldo is on the image. If I do this, I must know where Waldo is.

  2. Repeat step #1 till you are satisfied.

Why does this protocol work?

  1. If I know where Waldo is, I can easily answer challenge #2. That part is easy. It’s not so easy to figure out why challenge #1 is required.

  2. I could cheat by keeping some other image under the paper which has just many images of Waldo on it. How do you know that it’s actually the amusement park image and not some other image that I made up? Challenge #1 to the rescue. If you had asked me challenge #1, I had to remove the entire paper and show you that this was the amusement park image in question.

  3. Note that you cannot give me both the challenges at the same time, as that would tell you where Waldo is. Only one challenge per protocol round.

If we do this entire exercise just once, you could have asked me to answer challenge #2 and I could still cheat with a probability of 50%. If we do it twice successfully, I can still cheat with a probability of 25%. If we do it three times, it reduces to 12.5%. If we do it 10 times, and you picked your challenge randomly each time, I can cheat only with a probability of 0.1%. If we repeat this 20 times, the cheating probability drops to 0.0001%. And so forth, exponentially. Again, this only works if you pick your challenge randomly. If I know in advance that you will ask me the challenge sequence, of say, 122212121222111 – I can pass all challenges easily. The protocol works only if I am unable to guess your challenge sequence.

Cryptographic researchers have proven that almost any statement can be proven in zero knowledge. Imagine that! Any statement! It’s one of the most celebrated results in theoretical computer science, all the way back from 1986. The concept of Zero Knowledge Proof itself was introduced in 1985, after the original paper was rejected in major scientific conferences in the prior years because of how absurd the idea sounded. It still sounds counter-intuitive, if you ask me.

One popularly used ZK-proof system, solving a very specific problem, is that of Digital Signatures. When you digitally sign a document, you are proving to the verifier that you know a secret key to your public key (which the verifier already knows, or is tied to your identity, or some such). For the longest time, general purpose ZK-systems, which could prove any statement, were just theoretical results – the actual proofs themselves can be quite unwieldy and inefficient. Theoretical work continued, but there were still no practical applications that needed these proofs to get smaller, or easier to understand, or even remotely workable. 25 years went by, and people were mostly happy with either revealing everything about something to prove it, or having a trusted third party (like a Bank Officer or Notary) signing a statement saying that something is true, without revealing the underlying details. Ho-hum.

Enter Bitcoin!

Bitcoin removed the trusted third party from financial transactions. Or at least, introduced the idea that it could be done with clever cryptography and protocol design. Researchers who were toiling away in obscure labs and universities were suddenly like: “Hey, there are these amazing theoretical cryptography results from decades ago, let’s use them”. These ideas suddenly seemed ripe for more R&D to make them practical. And boy did the researchers and engineers deliver! Here’s a short list of how Zero Knowledge pervades the cryptocurrency space.

  1. New cryptocurrencies: Zcash, Monero, Grin, Beam, Mina, etc.

    • Everything about a transaction is hidden. Who is paying. Who is the recipient. What is the amount. Everything is hidden. Crucially though, verifiers can verify that the transaction is valid, and no one is cheating anyone. Zero knowledge magic. Details differ, but this is the general idea.

    • Additionally, Zero Knowledge proofs can verify large numbers of transactions without needing to store all those transactions. So, these ZK-blockchains can be as small as a few KB. For comparison the Bitcoin blockchain is 350GB and growing. Ethereum’s blockchain is 1TB or 5TB (depending on whom you ask) and growing.

  2. Layer-2: ZK-Sync, StarkNet, etc. bring the benefits of ZK-proofs to legacy blockchains like Ethereum and increase throughput quite dramatically.

  3. Other Proofs: Exchanges can use ZK-proofs to convince their users that they are not doing fractional reserve or rehypothecation shenanigans, and in fact, do custody all their customer assets.

What next?

Some of these general purpose ZK-systems have quite advanced cryptography, and their security guarantees are proven sometimes under ideal settings. When I say security guarantees, what I mean is:

  • Can the prover cheat?

  • Can the verifier learn something by violating the zero knowledge principle?

  • Can we do the entire thing without relying on cryptographic assumptions?

  • Some systems rely on an initial ceremony where some trusted party has to do one-off computation. Can we remove such requirements?

Practical minded people say that this stuff is too advanced, or “moon-math” as they call it. These primitives will not make it to Bitcoin for a LONG LONG time, if at all. Bitcoin’s cryptography is from an even older generation, and has been vetted in traditional settings like e-commerce, national defense, etc. No moon-math for Bitcoin!

That doesn’t mean that Bitcoin won’t benefit from these new developments. Bitcoin has evolved to a place now where the core protocol itself won’t change that easily, but additional features have to be built on top, in other layers. ZK-proofs will reside on a secondary layer somewhere on top.

Ethereum, on the other hand, is more open to these ideas. ZK-proofs are making their way into Ethereum’s core-system slowly, but will definitely pervade Ethereum’s Layer-2 ecosystem quite thoroughly in the near future. Much faster than in Bitcoin, from what I can see. Newer blockchains will go all-in, and will be built around ZK-ideas, or will offer them as native operators or subroutines.

You have the entire spectrum of blockchain platforms – some boringly conservative, and just trying to be sound money. Some others on the bleeding edge of maths, offering true privacy through ZK-proofs and the like. I expect these to become more mainstream as privacy becomes non-negotiable. Currencies, smart contract platforms, exchanges, and every other financial intermediary will go maths-first!


Our crypto series in reverse-chronological order:


Gross vs. Net Returns

The Government always has first dibs

First time investors often get bedazzled by tall claims of “20%” returns in direct equities. All they need to do is subscribe to an “exclusive” telegram channel or advisory service and mint their way to millions. Even if these claims were true, gross returns – the number often marketed – has little to do with the net returns that the investor finally realizes at the end of the year.

Very few know that a high-churn portfolio that delivers 20% gross returns is equivalent to a mutual fund that delivers 14% net. So, who ate your cheese?

Layers of Transaction Taxes

Securities Transaction Tax (STT)

The STT is an automatic tax collected by the government on all transactions irrespective of whether you made money on it or not. On equities, it is currently set at 0.1% – if you bought & sold 1 stock worth Rs. 100, then the government collects 20p on it. This is one of the biggest drags on high-churn strategies.

Last year, the government collected ₹16,927 crore in STT.1

Exchange Transaction Charges

The trading venue, typically the NSE (National Stock Exchange) or the BSE (Bombay Stock Exchange,) levies a transaction charge for allowing you to trade through them. This varies by exchange and they are know to give rebates to high volume brokers to keep them loyal. The last time I checked, it was around 0.00345% on the NSE.2

Stamp Duty

When the Central Government is skimming off through STT, why should State Governments be far behind? The states too have their hands in the till through “stamp duty.”

Stamp duty is a state levy paid to register a document, typically an agreement or transaction paper between two or more parties, with the registrar. In an era where all transactions are electronic and registering transactions is just flipping some bits in a database, this is basically free money to the states.

Before 2020, every state had its own rate but thankfully, the Modi Government rationalized it to a common rate of 0.015% on the buy-side of equities.3

SEBI Turnover fees

If you though that SEBI was an arm of the government and should be entirely funded by the general budget, the joke is on you. If you have a look at your contract note that the brokers sends you on the days that you trade, you’ll find a “SEBI Turnover Fee.” This is 0.00015% on both buys & sells. While its one of the smaller taxes/fees on transactions, it is still a percentage of total volume, so it adds up over time.4

During 2019-20, the total amount of fees and other charges collected by SEBI was Rs. 608.26 crore.5

Short-term and Long-term Capital Gains Tax

The rationale behind STT, introduced in 2014, was to replace the long-term capital gains tax. It was said that there was a lot of “leakage” in collecting LTCG and that a tax on transactions collected directly by the exchanges would plug it. However, the 2018 budget saw the re-imposition of LTCG.6

However, if your strategy demands churn, then you need to be worried more about STCG (15% on profits) than on LTCG (10% on profits.)

A High Bar of Direct-Equity

After all these taxes, levies and charges, when the numbers are tallied up at the end of the year, most direct-equity investors would be better off with a mutual fund.

The napkin math (sheet) above doesn’t consider brokerage – since those are mostly zero – and DMAT charges – those charged by CDSL – since those are flat fees charged only on sales.

Direct-equity investing strategies need to walk a fine line between optimizing for lower transaction costs, risk management and taxes. This is where we find advisory disclosures lacking. Most advisors do not disclose portfolio churn rates and nor do they indicate what the net, after-tax, returns would look like.

Also, a mutual fund’s NAV includes all of these charges and your portfolio compounds tax-free until you redeem. So, if you have a 5+ year time horizon, then compounding the 15% STCG adds significant tailwinds to your portfolio.

Conclusion

While comparing different strategies, investors should also consider portfolio churn and try and back into what the net, after-tax, returns would look like at the end of the year. Know that mutual fund NAVs are net of transaction costs and can compound tax-free.

Direct-equity strategies should clear a high-bar.


Looking for a sensible way to invest? Here’s how to get started.


Bitcoin's Secret Sauce

or: How I Learned to Stop Worrying and Love Nation State Attacks.

Bitcoin’s secret sauce, and how it works, was on full display these last few weeks. Bitcoin was designed to work against the most powerful of adversaries, and boy – did the adversary show up!

batman-v-superman-dawn-of-justice_bb788b6f

The China Syndrome

A few months ago, 45% to 75% of Bitcoin mining happened inside China. Then the Chinese government banned it.

There are anecdotal accounts from people on the ground are seeing Bitcoin mining operations being shut down by law enforcement agents. And there are similar accounts from people on the ground elsewhere in the world where containers full of mining hardware are being shipped to, lock, stock and barrel.

And then there is the Bitcoin blockchain – the source of absolute truth.

I have a copy of the Bitcoin blockchain on my computer, and could actually run the numbers myself and see that the production of Bitcoin blocks slowed down dramatically. Here’s a plot of how long it took, on average, to find 2016 blocks from 12-May-2014 to 18-July-2021.

Bitcoin blocks, on an average, are supposed to be generated once every 600 seconds. But you can see the spike in this number on the graph towards the end, going all the way up to 832 seconds. This means that during that period, the total number of active miners went down dramatically, and that led to the inter-block average-gap increasing equally dramatically from 600 seconds to 832 seconds.

Putting the anecdotal and canonical sources of data together, we can be reasonably certain that the Chinese mining ban lead to a global drop in Bitcoin mining.

Does it matter?

Not really. Miners come, miners go – Bitcoin chugs along. That is what it is designed to do. Bitcoin targets a block production rate of 600 seconds per block. If Bitcoin’s design had been naïve, whenever its dollar value went up, more miners would enter the system to make more money, and blocks would arrive faster than 600 seconds. Similarly, if its value went down (or if governments kicked them out), miners would leave the system, and blocks would arrive much slower than 600 seconds. The block production rate on either side of 600 would persist, and reflect the total number of miners in the system.

But no, that’s not what happens. No matter how many miners are in the system, it always takes around 600 seconds to mine a block. This is done through the difficulty adjustment algorithm, also known as Satoshi’s stroke of genius.

Difficulty Adjustment a.k.a Bitcoin’s Secret Sauce

Before we get to the difficulty adjustment algorithm, we have to first understand why keeping the inter-block interval of 600 seconds is important. Bitcoin works because everyone can check whether their perceived ownership of their own Bitcoin is fact or fiction. To check this, you need access to Bitcoin’s data? Where is this data? How big is it? How do I access it? Bitcoin’s data is not held by some central custodian, or a bank. It’s held by everyone who is interested. It includes all transaction from the genesis block onwards – from January 2009. But storing everything with everyone sounds crazy – and to be honest, it is crazy. But the more you think about it, the more you realize that there are no other easier ways of doing self-validation, other than offloading the “do I control my money or not?” question to someone else – and trusting them. Bitcoin prefers the opposite: self-validation.

So, if we accept the crazy idea that everyone stores a copy of the blockchain, we have a fundamental tradeoff – the blockchain cannot get very big (by growing very fast). It also cannot stay static: new transactions need to be added every so often to facilitate economic activity. Currently, the blockchain is around 377 GB, and growing at around 50 GB per year. If it grows too fast, not everyone will be able to hold their own copy. If it doesn’t grow fast enough, there is not enough transaction space to accommodate the demand for transactions. Under these constraints, Satoshi decided that a 1MB block every 10 minutes is a good tradeoff. To keep this tradeoff constant, blocks cannot be generated slower or faster.

What happens if Bitcoin’s value skyrockets and everyone wants to be a miner? Remember that a miner who generates a new block gets to keep the newly minted Bitcoin that comes out of each block. So, if the value of Bitcoin goes up, expect more miners to materialize. To accommodate this, Satoshi designed a simple algorithm that makes mining harder or easier depending on how long it takes to generate the previous 2016 blocks.

The Bitcoin protocol contains a positive number called “difficulty”, whose value is currently 13,672,594,272,814. This number controls how hard or easy it is to mine a block. Let’s say the total time taken to mine the previous 2016 blocks was greater than 2016 times 600 seconds, by a factor of X. This difficulty number is then adjusted lower by the same factor X. If the time taken to mine the previous 2016 blocks was lower, the difficulty number is adjusted upwards – again by the factor X. That’s it.

As far as “algorithms” go, this is as simple as it gets. It’s middle school level arithmetic. Other than combining existing ideas from cryptography and distributed systems, Satoshi’s only novel contribution was this middle school level formula. The genius, as they say, is in the simplicity of it.

When these erstwhile Chinese miners turned down their mining hardware around end of June/beginning of July 2021, Bitcoin’s mining difficulty dropped from 19 trillion to 14 trillion, by around 5 trillion – which is around 28%. The reduced difficulty made it easier for the remaining online Bitcoin miners to start generating blocks every 10 minutes again. The next 2016 block average was 630 seconds. Voila!

As Bitcoin’s value increased from 0 to wherever it is today, miners have only entered the system – and have rarely left. Difficulty has always gone up – to accommodate this increase in value. So, how does this difficulty number actually make it easier or harder to mine a Bitcoin block?

The Proof of Work Function

Bitcoin, famously, relies the “partial hash-preimage puzzle” to build its Proof of Work function:

You double hash data from the block you want to generate, and check if that hash value is less than the target on the right hand side of the equation. If it’s not, you change the block data, and try again, and again, and again, and again.

For example, if I double hash make-believe block-data, say the string “Bitcoin forever!”, I get the number:

99399038078883646938846821706752581723151100264172406332358249387420489004987.

The current value of the target is:

1971823790658122626473078926498088015421759366553927680.

So, it doesn’t work. I need to keep trying the function again and again with different block-data to hit gold. The actual previous Bitcoin block’s hash was 888160945014446794317532755205888398236464272495427689, which is under the required target, and that miner struck gold – so to speak.

If the difficulty number goes up, the mining target goes down, and finding block-data that double-hashes to a number lower than that target gets harder. It’s like tossing a 6 sided dice and wanting to hit a number less than or equal to 1. It happens only once every 6 times. If difficulty were to reduce, the target would move to a number less than or equal to 2. That happens every 3 times – mining just got easier.

Why go into the nitty gritty details of this function, with all the associated arithmetic and probability? I want to get into the properties that this unique function has, that makes it ideal for Bitcoin mining – and resisting nation state attacks.

Parameterizability: The function provides very fine degree of control over how much harder or easier we want the function evaluation to be. If you increase or decrease the difficulty number, the function becomes easier or harder to evaluate, respectively.

Memorylessness or Progress-free ness: Even if you have already run the function a million times, it still doesn’t give you any advantage over the next run. Each run of the function is what is called a Bernoulli trial – with the odds of hitting gold the same no matter how many times you have tried in the past. This makes sure that larger miners have no other advantage than just the larger chance of producing a block. If this property weren’t there, the largest miner would *always* win, even if they had just 0.0001% more power than the next largest miner.

The other incredible advantage of Memorylessness is that a miner can be turned off, put in a container, shipped elsewhere and plugged back in. The only loss the miner incurs is the Bitcoin that could have been mined in that interim time when the machine was turned off. Most physical objects being built, or even computations that are being performed on computers rely on previous data or “progress” that has been done, stored and retrieved, so that we can continue the process further. Shutting down something abruptly, without needing to store any state of progress, and starting elsewhere without any extraneous loss is not that common. This allows Bitcoin miners to be incredibly mobile and seek out the cheapest electricity wherever it exists. They are, in the true sense, plug-and-play.

Hard to compute, but easy to verify: To get the double-hash value which is under the target needs millions of trials of the function. But once someone finds it, the rest of us can verify it immediately with just a single iteration of the function. This, again, makes decentralization possible – where all of us can run the Bitcoin software on our computers and check that the miners are doing the right thing.

Replacing this function is not that easy. Most attempts have kept the general idea, and have tinkered with the specifics.

Conclusion

A nation state the size of China attacked Bitcoin where it’s supposed to hurt: Bitcoin Mining and all they managed to get in return was a giant shrug of indifference by the protocol. Yet another instance of Bitcoin living up to its promise of being designed to last forever. This self-adjusting nature of Bitcoin – that makes it change itself based on market conditions, with no one central entity being in charge – separates it from all other forms of money. Fiat money always has a central planner. Bitcoin has a protocol.


Our crypto series in reverse-chronological order:


Indians Investing Abroad

Make LRS work for you

There are quite a few reasons why Indians would want to invest overseas. Education, retirement and emigration are frequently cited as top priorities. In the past, the only way to do this was through the Liberalised Remittance Scheme (LRS) route. However, with Indian mutual funds finally waking up to increasing demand from investors, does investing in international public market securities through this process still make sense?

Liberalised Remittance Scheme

The Indian Government, through its various regulatory and enforcement arms, have traditionally tried to keep Indians from sending money abroad. The problem has always been that populist policies used to win elections end up choking growth and stoking inflation. This leads to investors pulling funds away from India – aka, capital flight. One way to stem the tide is to try and trap Indian capital within India.

We use the word “try” because we are all aware about the hawala network that thrives to this day because of these policies. Thankfully, the process of liberalization has slowly, in baby steps, opened the doors for Indians to legally remit funds abroad.

The Reserve Bank of India (RBI) sets the rules governing these fund transfers that banks need to follow. And banks are supposed to report and track these transactions both at the individual and aggregate levels. Given the paperwork involved, most banks require you to make a trip to a “designated” branch office and execute the instruction in-person. The whole process is cumbersome, requires paperwork and takes an hour or two to complete.

Not only is LRS is painful, it is also expensive.

Most people fixate on bank fees and GST but that’s only part of the story. The biggest scam is the exchange rate given by the bank – it is the worst possible rate that they can give you while still being compliant with rules & regulations. If you compare the “google” rate with the final transfer rate, you’ll find that the drag is about 3%

So, why do it?

More Choice, Less Cost

The US ETF market went through a decade-long price war that drove vanilla cap-weighted fees to almost zero.

For example, if you want to invest in the S&P 500 index, then Vanguard’s VOO ETF charges you 3bps for the privilege whereas Motilal’s index fund charges 50bps. If you consider the tax differential and the transfer knee-cap, you break-even by year 7. So, if you are a passive, buy & hold investor with a long enough time horizon, LRS makes more sense.

While costs are important, so are choices. You can access strategies beyond what Indian mutual funds deign to offer in the local market. For example, there are a ton of factor strategies available through ETFs that are probably never going to be launched in India.


Previously:

ETFs for Asset Allocation

The United States of ETFs


Lower Transaction Costs

Indian policy makers love to ape Western European policies without giving a second thought to its appropriateness given our stage of growth. One such self-goal has been the STT – Securities Transaction Tax – that taxes transactions rather than profits. And yes, we tax both short-term and long-term capital gains. Sort of like a dare: We’ll see how you’ll make money trading.

Fortunately, the US has avoided shooting itself in the foot so far.

Lets say, you fall in the 30% income tax slab. You have a trading strategy that makes 20% returns in both markets. The strategy turnsover the portfolio “x” times. Given 0.01% STT in India and zero brokerage in the US, what is “x” for you to be indifferent in Year 1?

If you turn over your portfolio more than 60 times, you would be better off deploying that strategy in the US rather than India.

If you set the gross returns to zero, the required turnover drops to 30.

However, if you only trade infrequently, then LRS may not the best way to go. For example, a 40x turnover strategy will need 3 years to be indifferent.

Basically, if you are going to trade frequently, doing it in the US makes a lot more sense.

Caveats

LRS ensures that you will need a Chartered Accountant to do you taxes. You need to account for the dividends you have received, report your net personal assets, etc. So this route doesn’t make sense for small accounts.

If you don’t share your trading and banking passwords with your next-of-kin, then you need to be worried about US Estate laws. The U.S. has jurisdiction over U.S.-situated assets and requires executors for nonresidents to file an estate tax return if the fair market value at death of the decedent’s U.S.-situated assets exceeds $60,000. Directly investing in U.S.-situs assets as a non-U.S. investor creates potential U.S. estate tax liabilities.1

Conclusion

We feel that the LRS route is attractive both for a buy & hold investor as well as an active investor with an edge. However, one should get into it knowing the trade-offs involved.


If you are looking for simple, pre-canned investment strategies to invest in the US, check out freefloat.us


The United States of ETFs

Just can’t get enough.

For the longest time in the US, actively managed mutual funds ruled the roost. Then came Jack Bogle with his index fund and the ceaseless mantra of “costs and taxes matter” and the dynamic shifted, slowly at first and then suddenly, in favor of indexing. It was only a matter of time before people figured out the tax loophole of ETFs and now, there are over 2500 ETFs listed in the US.


Previously: ETFs for Asset Allocation


The Tax Loophole

Unlike in India, where mutual funds are “pass through,” US mutual fund investors pay capital gains tax on assets sold by their funds. When there are large-scale redemptions, say, during a market melt-down, funds are forced to sell their holdings. This generates capital gains taxes, meaning that investors have to pay tax on assets that had fallen sharply in value1.

ETFs​, on the other hand, don’t have to subject their investors to such harsh tax treatment. ETF providers offer shares “in kind,” with authorized participants serving as a buffer between investors and the providers’ trading-triggered tax events.

A Plethora

Of the ETFs that survive today, the number of launches every year has trended higher.

While Equity ETFs dominate launches, the share of fixed income, alternatives, etc. has increased as well.

Most of the AUM resides in “vanilla” strategies – typically market-cap based.

The winner HAS taken all

Plot the assets of each ETF, in billions, in log-scale and you can tell that this is a game of scale.

Of the total 2577 ETFs, 2022 (78.5%) have less than a billion dollars in assets. You need to filter for $10 billion and up to just see the x-axis.

The top 3 issuers: Blackrock, Vanguard and SSGA manage ~80% of all ETF assets.

Where there is an ETF, there’s an Index

Until last year, ETFs were supposed to be a “passive” entity. There were no “actively managed” ETFs. In order to be passive, an ETF needed to follow an index. And indices had to be rules based – however convoluted the rules. And issuers needed a third-party to provide the index.

The rise of ETFs (and passive investing, in general) put index providers in the middle of all the a action. They became a crucial cog in world finance that can make or break entire economies. So powerful, in fact, that China blackmailed MSCI to include its domestic stocks in its Emerging Markets Index, which is tracked by close to $2 trillion in assets2. And India has been working on inclusion of Indian sovereign bonds in global bond indices3.

We can see industry consolidation here as well. The top 5 index providers control ~75% of ETF AUM (more if you include index funds.) S&P Global and MSCI are as close to “pure-play” index providers as you can get and their stock market performance is off-the-charts.

Fee Squeeze and Innovation

The problem with index ETFs/funds is that buyers only care about two things: expense ratio and tracking error. This resulted in a massive fee war that saw the vanilla-passive industry consolidate around Blackrock and Vanguard. For example, Vanguard’s S&P 500 ETF’s expense ratio is 3bps.

So, what next?

International ETFs

The first wave was ETFs providing international diversification. However, the “home-bias” is pretty strong with AUM under international ETFs barely making a quarter of the total.

On a weighted average basis, these ETFs charge about 30bps. However, since these are mostly cap-weighted, the fee-war is just as intense here.

Leveraged/Inverse ETFs

Many investors have mandates that prevent them from trading derivates outright. This is especially true for Indian investors taking the LRS route to invest in the US. However, Wall Street has your back.

Leveraged ETFs give you 2x or 3x the daily returns of a benchmark index like the S&P 500 or the Nasdaq 100. Feeling bearish? Inverse ETFs do the opposite.

Caveat: These are NOT buy-and-hold investments and are more suitable for day-traders. The discussion requires a separate post.

On a weighted average basis, these ETFs charge about 100bps. While lucrative, they are mostly niche.

Active ETFs

An ETF’s tax-free wrapper make it an order of magnitude more attractive than an identical mutual fund. New issuers/managers have taken advantage of this and launched actively managed ETFs.

On a weighted average basis, active ETFs charge about 50bps. These are still early days for this category – they barely make 5% of total ETF assets. Liquidity and tracking errors during market crisis are yet to be tested.

Conclusion

There is a plethora of choices when it comes to ETFs in the US. If you plan to wander away from the plain-vanilla stuff, please take the time to read the prospectus and understand how it works.

If you are looking for simple, pre-canned investment strategies to invest in the US, check out freefloat.us