Russian mutual funds: skill versus luck

Pic. 7 Real daily alpha distribution

All three models are presented on the graph. CAPM is with dotted line and has the highest peak. Specification with Brent oil in rubles has the middle pick and is the one with dashed line. The solid line goes for model with Brent oil and USD/RUB with the lowest peak. The distributions are practically the same for all model specifications. The difference is in the middle peak and there is a slight spread among the lines all over the graph to compensate this peak. According to the statistics above most funds have negative alphas and the mean value for the distributions are also negative, but the peak is to the right of zero. It means that the mode is positive. The difference in mode and mean (and median) are due to a sharp slope in the left part of the graph. There are more high negative alphas than high positive. But it does not necessarily mean that there are more funds with bad skill. It is because many funds are industry oriented or have strict policy to invest in second-tier stocks or blue chips. And due to bad luck that industries or part of the market face problems and show negative dynamic. The mentioned funds will follow them and thus have negative alphas. At this point it is hard to conclude which model is underestimating or overestimating alphas. And since the differences in results are minor the final results for bootstrap may not differ much. As an efficiency criteria can be used r-squared to compare the models. Also, it is important to test the residuals of regressions to move on. Since real market data usually do not have normal distribution of returns and errors of regression, the result will probably be the same for this research. The so goes for autocorrelation of residuals. It also is one of the points to use bootstrap approach. As it was mentioned in core papers bootstrap is a good method to deal with data that has autocorrelation and not normal distribution of residuals.

Pic. 8 R-squared of three models

The lines are the same as on Picture 7: CAPM - dotted, Brent oil in rubles - dashed, Brent oil and USD/RUB - solid line. From Picture 8 it can be clearly seen that model specification with separate factors Brent oil and USD/RUB is better than the others in terms of r-squared. But the results for all models are poor: for most funds r-squared is close to zero. That is because there is quite a number of funds that invest in foreign assets: shares, ETFs, commodities and etc. These funds have low correlation with Russian market and thus low beta. Without any appropriate factors for foreign assets the only part of regressions that has influence for such funds is constant value or alpha. In this case alpha will be close to mean value (of dependable variable) and fitting errors and their standard deviation will be high. Thus r-squared is low. Its mean for each model is about 0,2. Most likely plenty of funds invest in assets that have almost none correlation with the benchmark and other factors in the model. Also, if the models are based on another benchmark - Micex, then r-squared is almost the same for that period. The statistics for three models with MSCI Russia benchmark and one model with MICEX are presented in Table 5.

Table 5

Statistics for R-squared

Model	Min.	1st Qu.	Median	Mean	3rd Qu.	Max.	St.Dev.
Brent in Rub	0,0006	0,0298	0,1537	0,1985	0,3439	0,6003	0,1738
Brent and Rub	0,0007	0,0419	0,1608	0,2066	0,3509	0,6042	0,1737
CAPM	0,0000	0,0278	0,1390	0,1925	0,3344	0,5945	0,1735
Brent and Rub MICEX	0,0005	0,0364	0,1707	0,2036	0,3490	0,5744	0,1667

Judging from r-squared the models are close enough to each other. The results for different benchmarks are practically even. Higher median for model based on MICEX means that among low r-squared funds have higher r-squared than for model with MSCI Russia, while lower mean suggests that there are more funds with high r-squared for MSCI Russia than for MICEX. Since median is lower and mean is higher (with higher max values) than standard deviation should be higher too. Model with MICEX seems to have higher r-squared in the second quarter and it's the only part where this model prevail. All these can be seen from the table above. Since the minimum, first quarter and mean values are higher for MSCI Russia model it is slightly better to use this benchmark instead of MICEX. Among the models the best one seems to be specification with separate factors of Brent oil and USD/RUB. It is probably because the currency pair has its own unique influence on the market and funds, while crude oil do not suffer dramatic changes from switching the currency.

Before moving on to bootstrap simulations the errors of the regressions should be tested for autocorrelation and normality. Along with errors funds` returns are also tested. As normality test is used Jarque-Bera test. Most funds have more than 1500 observations and so do residuals. The null hypothesis for this test is that the data has normal distribution, which means skewness and excess kurtosis are zero. The p-value for all funds` returns and regression residuals are close to zero. Only one fund (VTB fund of power industry) has p-value around 0,01 for regression with Brent oil and USD/RUB, but since the significance level is 5% the null hypothesis is rejected for all funds` returns and residuals. So, no fund has normal distribution of residuals (and returns too). To test sample for autocorrelation in residuals was chosen Durbin-Watson test. It only tests first order autocorrelation and the null hypothesis is that the residuals are serially uncorrelated. The alternative claims that there is first order autocorrelation. Null hypothesis was rejected for from 134 to 139 funds depending on model specification. But the dw statistics was always between 1 and 3, meaning the spotted serial autocorrelation is not dramatic. As the core papers suggest bootstrap approach can deal with autocorrelation in residuals since the residuals and changed in random order to create portfolios. The results for residuals tests are presented in Appendix 4.

The first method to measure the skill of a funds is suggested by M. Jensen as it was mentioned in theoretical background: the higher alpha the fund has the higher level of skill the manager has. According to this theory the funds that have top alphas can be described as skillfully managed. They should have picking skills. It should be better to track the dynamic of alphas and if a fund has alpha among top for many periods then the fund is truly managed skillfully. But since the overall period of time should be long enough there are no such funds. The funds in the sample have been functioning for different period of time and thus have different number of observations. It makes them uneven. A certain fund can maintain high alpha for a short period of time but with time alpha will drop. That is why alpha as it is may be not the most accurate measure of managers` skills. But it still can be useful to look through it. Even though it may not be the appropriate method, but it is assumed that skilled funds are in the tales of alpha distribution. At this point the market is assumed to have 2,5% funds with positive skill and the same amount of negative skill funds. The proper way should be to choose the interval of alpha`s values, one for positive skill and one for negative. But this intervals may be assumed to be equal those from previous method. Then for significance level of 5% the best and worst 2,5% of funds have positive and negative skills respectively. Thus for 175 funds there are 4 funds with positive skill and 4 funds with negative skills. Table 6 shows the top alphas according to three models. Table 7 - the worst alphas.

Table 6

Top 4 alphas from each model.

Brent in Rub	Alpha	Mean returns	N_obs
alfakapital_aktsii_rosta	0,0008	0,0011	530
alyans_aktsii_vtorogo_eshelona	0,0011	0,0013	631
aleksandr_nevskij	0,0014	0,0014	477
tkb_bnp_pariba_perspektivnye_invest	0,0021	0,0022	610
Brent and USD/RUB	Alpha	Mean returns	N_obs
sberbank_fond_aktsij_kompanij_maloj	0,0009	0,0012	1285
alyans_aktsii_vtorogo_eshelona	0,0011	0,0013	631
aleksandr_nevskij	0,0014	0,0014	477
tkb_bnp_pariba_perspektivnye_invest	0,0020	0,0022	610
CAPM	Alpha	Mean returns	N_obs
alfakapital_aktsii_rosta	0,0009	0,0011	530
alyans_aktsii_vtorogo_eshelona	0,0012	0,0013	631
aleksandr_nevskij	0,0014	0,0014	477
tkb_bnp_pariba_perspektivnye_invest	0,0021	0,0022	610

Table 7

Lowest 4 alphas from each model.

Brent in Rub	Alpha	Mean returns	N_obs
merkuri_globalnaya_elektroenergetika	-0,0015	-0,0013	766
rajffajzen_elektroenergetika	-0,0009	-0,0007	1547
baltinvest___fond_elektroenergetiki	-0,0009	-0,0006	1494
interfin_elektroenergetika	-0,0008	-0,0006	1554
Brent and USD/RUB	Alpha	Mean returns	N_obs
merkuri_globalnaya_elektroenergetika	-0,0015	-0,0013	766
rajffajzen_elektroenergetika	-0,0009	-0,0007	1547
baltinvest___fond_elektroenergetiki	-0,0008	-0,0006	1494
alfakapital_elektroenergetika	-0,0008	-0,0006	1728
CAPM	Alpha	Mean returns	N_obs
merkuri_globalnaya_elektroenergetika	-0,0015	-0,0013	766
rajffajzen_elektroenergetika	-0,0009	-0,0007	1547
alfakapital_elektroenergetika	-0,0008	-0,0006	1728
baltinvest___fond_elektroenergetiki	-0,0008	-0,0006	1494

The results for different models are similar. The first and last three are the same and the 4^th and 5^th are swapped in one model. What is more the funds with top alphas have almost the same places in terms of mean returns. The top five alphas have the top five mean returns. Since all funds from with lowest alphas are oriented on investments in power industry, the last has probably have harsh times during the analyzing period. As it was mentioned above the results are sensitive to the number of observations or the period of time for which alpha is estimated. And that can be seen through the tables above. The funds that have top alphas have low number of observations (3-4 times lower than the whole sample). Thus the results are inappropriate. If, for example, the total number of observations in the models are shorten to 500 observations, which means 2 years, there could be different results. The statistics of this experiment are presented in Table 8.

Table 8

Statistics of alphas for 500 observation models.

Model	Min.	1st Qu.	Median	Mean	3rd Qu.	Max.	St.Dev.
Brent in Rub	-0,001692	-0,000374	-0,000123	-0,000195	0,000124	0,001361	0,000560
Brent and Rub	-0,001652	-0,000358	-0,000117	-0,000182	0,000124	0,001371	0,000552
CAPM	-0,001675	-0,000369	-0,000122	-0,000189	0,000128	0,001357	0,000559

The statistics represents poorer performance for the funds with shorter period. It means that the last two years of the initial period are worse than the sample at average and they even impair the nine years of performance. It can be seen through the lower values of all statistics except for standard deviation, which is higher, but that also is worse. The mean and median values for previous setup are almost zero, but for 500 observation models they are negative and ten times further from zero. In general new alphas are lower by 20-30%. The purpose of the experiment was to compare top alphas of these sample with the initial sample. Top and worst alphas are presented in Table 9 and Table 10. There are still funds that have less than 500 observations, but there are very few of them. Also, among top and worst there is one fund that has a little less than 500 observations. But the difference is insignificant.

Table 9

Top 4 alphas from 500 observation models.

Brent in Rub	Alpha	Mean returns	N_obs
sberbank_potrebitelskij_sektor	0,0007	0,0003	500
sberbank_telekommunikatsii_i_tekhno	0,0008	0,0008	500
sberbank_globalnyj_internet	0,0009	0,0008	500
aleksandr_nevskij	0,0014	0,0014	477
Brent and USD/RUB	Alpha	Mean returns	N_obs
alfakapital_potrebitelskij_sektor	0,0008	0,0002	500
sberbank_telekommunikatsii_i_tekhno	0,0008	0,0008	500
sberbank_globalnyj_internet	0,0009	0,0008	500
aleksandr_nevskij	0,0014	0,0014	477
CAPM	Alpha	Mean returns	N_obs
sberbank_potrebitelskij_sektor	0,0008	0,0003	500
sberbank_telekommunikatsii_i_tekhno	0,0008	0,0008	500
sberbank_globalnyj_internet	0,0009	0,0008	500
aleksandr_nevskij	0,0014	0,0014	477

Table 10

Lowest 4 alphas from 500 observation models.

Brent in Rub	Alpha	Mean returns	N_obs
rajffajzen_elektroenergetika	-0,0017	-0,0007	500
uralsib_energeticheskaya_perspektiva	-0,0016	0,0002	500
alfakapital_elektroenergetika	-0,0016	-0,0006	500
sberbank_elektroenergetika	-0,0016	-0,0001	500
Brent and USD/RUB	Alpha	Mean returns	N_obs
rajffajzen_elektroenergetika	-0,0017	-0,0007	500
uralsib_energeticheskaya_perspektiva	-0,0016	0,0002	500
alfakapital_elektroenergetika	-0,0015	-0,0006	500
sberbank_elektroenergetika	-0,0015	-0,0001	500
CAPM	Alpha	Mean returns	N_obs
rajffajzen_elektroenergetika	-0,0017	-0,0007	500
uralsib_energeticheskaya_perspektiva	-0,0016	0,0002	500
alfakapital_elektroenergetika	-0,0015	-0,0006	500
pallada___energetika	-0,0015	-0,0005	500

The mean returns in the tables are for the whole sample (9 years), alpha and number of observations are for new sample. It is made so that funds alphas can be compared with previous results (since mean returns are close enough to alpha in the previous regressions). As it can be seen from the tables that the top and worst funds in terms of alpha have changed. But the same as for initial sample energy sector has been underperforming the market during the last two years of the initial period. Among the funds with top alphas only “Aleksandr Nevskij” is still presented. This can only mean that previous top funds with a bit more than 500 observations have huge and positive returns during the period of time which is out of the current sample. Previously the worst fund “Merkuri globalnaya elektroenergetika” is no longer among such probably because most significant negative returns it has had before the current sample. “Uralsib energeticheskaya perspektiva” is far away from worst in nine-year period, “sberbank potrebitelskij sector” and “alfakapital potrebitelskij sector” are not among the top in initial sample too. These funds outlines the problem of having funds with different life time when estimating skill with alphas: while a fund with smaller number of observations can have good results it may be would not have such for the whole sample period, moreover, if funds with lower results but full history will be shorten to the same amount of observations it may outperform that fund.

The problems mentioned above can be solved using approaches that create the distribution of luck for each fund. As long as they bring out critical values for each fund that characterize skill even funds with the highest alphas will not be considered skillfully managed if they do not pass the border. One of the method to obtain this distribution of luck is bootstrap approach.

The process of bootstrap approach is described in short in chapter “Theoretical background”. More detailed information can be obtained from the core papers, the authors of which are the founders of this methodology of evaluating funds' skills. The approach is used to produce a huge number of random portfolios that are created without skill. This zero skill portfolios make distribution of luck, which should represent all possible results in general. To be managed skillfully a fund should be among top in this distribution of possible results. Bootstrap is the process of creating a huge number of portfolios that have same characteristics - coefficients in regression. It is an artificial sample for each fund. By changing the alpha coefficient to zero for new portfolios during this process the distribution of luck for initial fund is created.

As it was already mentioned, the first step is to store beta. Also, analyzing beta can provide useful information about the funds` performance and models used. The statistics can be seen in table 11.

Table 11

Statistics for beta coefficients for three base models.

Brent in Rub	Min.	1st Qu.	Median	Mean	3rd Qu.	Max.	St.Dev.
Brent in Rub	-0,1546	-0,04093	-0,003024	0,0087	0,04014	0,1825	0,065526
RMP	-0,04082	0,09946	0,2591	0,2744	0,4374	0,7856	0,191259
Brent and Rub	Min.	1st Qu.	Median	Mean	3rd Qu.	Max.	St.Dev.
Brent	-0,08278	-0,01563	0,01684	0,02857	0,06129	0,205	0,061196
USD/RUB	-0,7479	-0,249	-0,1728	-0,1656	-0,081	0,493	0,16222
RMP	-0,04333	0,09335	0,244	0,2638	0,4233	0,7825	0,190008
CAPM	Min.	1st Qu.	Median	Mean	3rd Qu.	Max.	St.Dev.
RMP	-0,03456	0,1103	0,2813	0,2768	0,4275	0,7798	0,184929

The statistics of beta can explain low r-squared for some funds. For a certain fund with a certain model specifications with beta coefficients close to zero r-squared will be low. It is because fitting errors will be very large with high standard deviation and alpha of such fund will be close to mean value of dependent variable. Risk market premium or the benchmark has the highest betas. It means that many funds have high correlation with the market. But the funds that are uncorrelated with benchmark have low r-squared. Judging from the table the model with most influential coefficients is specification with Brent oil and US dollar prices in rubles. The higher standard deviation for risk market premium in this model in comparison with CAPM specification can be explained by correlation of explanators, but the difference is small, so it is not critical. Most funds have positive beta and correlation with the market (RMP). No fund can show returns systematically opposite to the market, as there is no beta with high negative values for RMP. Also, rising dollar can harm most of the funds as they have negative beta with US dollar ruble prices. Crude oil in US dollars have small betas, most of them are positive, but most values are close to zero. Since the data represents returns and Brent oil do not have higher volatility than the market, small beta can mean low influence on funds` returns above risk-free rate. Brent in rubles have different influence and its direction on different funds, because median and mean are close to zero. It is logical since USD has negative influence and Brent - slightly positive (while currency changes have smaller volatility, small positive Brent influence can match negative from dollar).

The next step to get distribution of luck is connected with residuals. Fitting errors are the only thing that differentiate random portfolios for one fund. Unique features of fund`s performance are stored in residuals, which are used to create a new portfolio: the only limitation of new series of residuals is that it should have the same length, meaning that not all observations can be used and the order is random. Also, these residuals are the part of research were high risk or small number of observations is properly dealt with. If a certain fund has small number of observations and because of that has high returns and is outperforming most other funds with longer series it will have huge fitting errors. In the process of resampling (with possibility to replace) of residuals new series of pseudo residuals will also have large fitting errors and some of them may have even greater. Because of that the distribution of luck for this particular fund can be shifted to the right and the real fund`s alpha can be smaller than the critical value and thus it will not be considered as skilled. The process of resampling is shown on Picture 9.

Picture 9 The process of creating pseudo errors

Some residuals are duplicated and some excluded. But the problems appear when funds have missing values. Here different assumptions may take place. Residuals can be mixed alongside missing values and then sorted. In such case the initial length for funds with missing values can be changed a bit. The less observations a fund initially has the more new missing values will appear. For funds with a few missing values it is vice versa, the sample will increase. More logical will be to make all the new residuals with full length. The initial residuals will be reorder and replaced with 2209 observations (maximum length). Another possibility is to replace only existing values, so that the length of pseudo returns will match number of observations of the initial sample. Picture 10 illustrates simple examples for all three options.

Picture 10 Pseudo residuals types

This research is based on option 3, only existing values are shuffled and replaced. But one model is also tested with option 2. The results are presented after the final step in this approach. As a result of this step a matrix with 175 columns and 2209 rows is created. Each fund has its own column with one set of pseudo residuals in it.

When pseudo residuals are ready new “unskilled” returns can be estimated. Using the same regression with the same beta but new residuals and zero alpha will bring out a set of returns above risk-free rate with zero skill. Since the regression from which initial residuals were taken has returns above risk-free rate, the new pseudo returns also include this factor. These returns forms a new portfolio that is operated solely by luck.

The last step in the loop is to estimate alpha for pseudo portfolio. This time all the coefficients belongs only to it. The estimated alpha is one of many that forms a distribution of luck in terms of picking stocks. This is an important note, because alpha is responsible for picking skills.

One loop consists of 3 parts. The first on is to estimate one series of pseudo residuals for each fund. The second - to restore pseudo returns (again one series of returns for each fund) using zero alpha, beta (that was stored earlier), pseudo residuals in the regression. And the third - to estimate alpha of new returns using one of the model specifications. Repeating the loop by many times provides many alphas. This alphas form distribution of luck. In this research number of bootstrap iterations is 1000. Accuracy of results is rising with number of iterations. But in order to include all the assumptions the code in R is made complicated and it takes about 30 hours to estimate the results on average home computer.

Table 12

Statistics of simulated alphas and real alphas.

Brent in Rub model	Min.	1st Qu.	Median	Mean	3rd Qu.	Max.	St.Dev.
Real alphas	-0,00150	-0,00026	-1,70E-05	-3,97E-05	0,00016	0,00207	0,00041
Simulated alphas	-0,00588	-0,00024	7,07E-07	-1,21E-07	0,00025	0,00645	0,00045
Brent and Rub model	Min.	1st Qu.	Median	Mean	3rd Qu.	Max.	St.Dev.
Real alphas	-0,00150	-0,00025	-1,43E-07	-2,20E-05	0,00019	0,00204	0,00040
Simulated alphas	-0,00631	-0,00024	-1,89E-06	-1,78E-06	0,00024	0,00705	0,00044
Full Length Simulations	-0,00287	-0,00021	9,72E-07	9,50E-07	0,00021	0,00308	0,00034
CAPM	Min.	1st Qu.	Median	Mean	3rd Qu.	Max.	St.Dev.
Real alphas	-0,00151	-0,00026	-8,99E-07	-3,50E-05	0,00016	0,00208	0,00041
Simulated alphas	-0,00684	-0,00025	2,50E-06	1,72E-07	0,00025	0,00600	0,00045

The distributions of all simulated alphas in comparison with real alphas for Brent in rubles and CAPM model can be found in Appendix 5. Each one consists of 175000 alphas and represent the whole market`s possible results according to one of the models. The statistics of real and simulated alphas are compared in Table 12.

Previously it was mentioned that there are two proper options to deal with pseudo residuals. All the cases presented in the table above mix and replace only existing observations. One of them also fill up the missing values by duplicating existing residuals in the same way they are mixed replaced. Doing so all the pseudo returns have maximum observations and so have the new pseudo portfolios. There are both pros and cons from economic point of view. Fitting errors for small existing period will be retranslated on period with worse economic situation on the market and thus the pseudo portfolio will be outperforming the benchmark and vice versa for better economic situation. At one point it makes funds with high alphas and short time period have a more suitable simulated distribution with higher alphas. But if the situation on the market was better in the past periods and residuals from worse times are retranslated than some funds can be overestimated. Same goes for funds with bad skills that will be underestimated in the first case and overestimated in the second. This model seems to have lower standard deviation, so the alphas are not scattered far away from each other. This grouping will lead to more funds with good and bad skills. More about the model can be found next to overall results.

A proper comparison should involve distributions of both real and simulated alphas. The research involves 3 models, model with separate factors Brent oil and USD/RUB is slightly better than others. That is why its results are presented below on Picture 11 and distributions for other two are presented in Appendix 5.

Solid line on the graph represents distribution of all simulated alphas (for each fund) for model specification with Brent oil and USD/RUB, dashed line is real alpha distribution for the same model. As expected the mean value of simulated distribution is close to zero. The distribution is almost symmetric to zero line except for the peak, which is slightly to the left. This peak is compensated with a higher left part. Picture 11 illustrates that there more funds that are underperforming, since there are more funds with high negative alpha and less funds with high positive. The statistics tells the same: 1^st and 3^rd quarter values of real alphas are smaller than simulated. Higher long tails of real distribution suggests that there some funds that may have skill (both positive and negative). But in general according to this graph there is no evidence of superior performance for Russian funds.

Picture 11 Distributions of real alphas compared to bootstrap alphas

And what comes for single funds? The bootstrap approach allows to estimate skill of each fund separately, because there is special distribution of luck for each fund. The process of measuring skill was already mentioned in other chapter. Picture 12 illustrates it on an example for one fund.

The graph presents the distribution of simulated alpha for fund "Alfa capital aktsii" estimated with model containing Brent oil and USD/RUB factors. The dashed lines are critical values. They are estimated as percentiles of series with simulated alpha. The solid vertical line is value for real alpha. If the solid line is between two dashed, then there is no evidence of skill. If the real alpha is in the right part of the graph and pass right dashed line then the fund is managed with positive skill, to the left - the skill is negative and managers are destroying fund`s value. But here there is a dilemma: what percentiles should be chosen. If the zero hypothesis is “random returns for a fund” then there are two sides of nonrandom returns for alternative hypothesis: skill to provide positive returns and outperform benchmark and negative skill to destroy value and underperform. If this zero hypothesis is being tested, then for 5% significance level the percentiles should be 2,5% and 97,5% (so that 95% is in the center). But then the alternative hypothesis is two sided and it can be split into two: one, fund`s positive performance is nonrandom, the other one: fund`s negative performance is nonrandom. Then zero hypothesis can also be divided into two parts: funds positive results are random and funds negative results are random. In this situation for 5% significance level the percentiles will be 5% and 95%. This way there will be more funds with positive and negative skill. This case is equivalent to 10% significance level for the previous hypothesis. Picture 12 illustrates only an example. The results for all funds (only for model with Brent oil and USD/RUB) are presented on the Picture 13.

Picture 12 Measuring skill

There are two graphs below. The upper one represents real alphas of funds and their critical values. The lower graph shows which fund has positive or negative skill. The critical value on top is 97,5% percentile and on bottom - 2,5%. As it is clear from the graph no fund has positive skill. Even the highest alphas have even bigger critical values, because their high fitting errors form a few series of high pseudo returns. But there are some funds on the border and can be assumed skilled if the significance level is raised. Another case occurs with negative skill. Some of them are also on the border but from the other side. There are total of 6 funds that have nonrandom negative returns according to this approach. A few funds that are close to the border can have their results changed if number of simulations is changed or by chance (since simulations are random then if number of bootstrap iterations is low there can be different results for the same setup).

Picture 13 Funds results for Brent and USD/RUB model, 5% significance level for initial H0

Since there are no funds with positive skill with 5% significance level, the last should be increased. As it was already mentioned if the initial hypothesis is divided in two, then the fund`s alpha has to beat 95% of simulated alphas instead of 97,5% to claim skill. Thus the two new hypothesis should be tested. The real and simulated alphas remain unchanged, only the critical values will be a bit closer to zero. The graph with new borders for skill is presented on Picture 14.

The graph shows that with changes in percentiles 3 more funds are suggested to have negative skill and also 3 funds with positive appears. In this situation inside the borders there are 90% of simulated alphas. Among the 5% top alphas there are three funds, among the bottom 5% 9 funds. These funds will be mentioned later. There is no point to further increase the significance level and press the borders even further to zero. Other funds that are not outside the borders can be ranked by the difference between their alphas and critical values. The closer they are to the top border - the more chances that they are managed skillfully. This goes only for funds inside the borders. The ones that are outside should be ranked how much further from the border they are.

Picture 14 Funds results for Brent and USD/RUB model, 10% significance level for initial H0, 5% for two new H0

Practically the same situation is with the two other models. The results can be found in Appendix 6. For initial H0 with 5% significance level CAPM claims that there are 6 funds with bad skill and model with Brent oil in rubbles suggests 7. For both cases no fund has positive skill. If borders are expanded to 10% significance level (or 5% for two new hypothesis) then CAPM has 2 funds with alphas above critical value and 9 below the bottom border, while Brent oil in rubles suggest that 3 funds have positive skills and 10 - negative. Both cases with initial H0 and two new hypothesis shows that the market of equity funds in Russia in general is managed without good skills as most funds have no evidence of nonrandom performance and negative skills prevail.

A little different situation is when all pseudo residuals are filled with full length observations (2209 in this research). Since the distribution of simulated alphas is more compressed (its minimum,1^st and 3^rd quarter, maximum are closer to zero in comparison with other simulated alphas distribution) there are more funds with good and bad skills. Moreover, there is no need to increase significance level as the number of skilled funds is comparable with 10% significance level for other models. The results are presented on Picture 15.

Picture 15 Funds results for Brent and USD/RUB model with 2209 obs residuals, 5% significance level for initial H0

Once again funds with negative skill prevail. The graph shows that 2 funds have positive skill and 13 funds - negative. If the significance level is increase the number of funds with skill rise to 7 for positive and 18 for negative. As it can be seen from the graph the border lines have lower peaks. That is why the funds that are not considered skillful even for 10% significance level for other models can have skills according to this one. This model is arguable but the results still may be taken into consideration (with adjustment using other models) in the process of decision making.

The funds that are considered to have nonrandom positive returns for all models are presented in Table 13. The funds with negative skill can be found in Table 14. The tables show funds` names, their alphas, critical value and distance from border (real alpha minus critical value - a way to rank funds).

Table 13

Funds with positive nonrandom returns.

Positive skill
Fund	Real alpha	5%	10%
		Critical value	Difference	Critical value	Difference
Brent and Usd/Rub
interfin telekom	0,000481	0,000509	-0,000027	0,000432	0,000050
univer fond aktsij	0,000412	0,000445	-0,000032	0,000387	0,000025
sberbank globalnyj internet	0,000670	0,000714	-0,000043	0,000585	0,000086
Brent in Rub
interfin telekom	0,000473	0,000512	-0,000040	0,000413	0,000059
sberbank globalnyj internet	0,000653	0,000701	-0,000049	0,000613	0,000040
univer fond aktsij	0,000402	0,000477	-0,000075	0,000398	0,000004
CAPM
sberbank globalnyj internet	0,000723	0,000750	-0,000028	0,000667	0,000055
interfin telekom	0,000469	0,000537	-0,000068	0,000456	0,000013
2209 obs Brent and Rub
tkb bnp pariba perspektivnye invest	0,002040	0,001525	0,000515	-	-
sberbank globalnyj internet	0,000670	0,000346	0,000324	-	-

Table 14

Funds with negative nonrandom returns.

Negative skill
Fund	Real alpha	5%	10%
		Critical value	Difference	Critical value	Difference
Brent and Usd/Rub
merkuri globalnaya elektroenergetik	-0,001502	-0,000932	-0,000570	-0,000814	-0,000688
alfakapital elektroenergetika	-0,000800	-0,000617	-0,000182	-0,000522	-0,000278
pallada energetika	-0,000800	-0,000697	-0,000103	-0,000595	-0,000205
interfin elektroenergetika	-0,000785	-0,000748	-0,000037	-0,000575	-0,000210
rajffajzen elektroenergetika	-0,000888	-0,000854	-0,000034	-0,000738	-0,000150
bks aktualnye idei	-0,000564	-0,000560	-0,000004	-0,000476	-0,000088
rgs elektroenergetika	-0,000725	-0,000778	0,000053	-0,000648	-0,000077
baltinvest fond elektroenergetiki	-0,000817	-0,000973	0,000156	-0,000815	-0,000002
stoik elektroenergetika	-0,000708	-0,000912	0,000204	-0,000689	-0,000020
Brent in Rub
merkuri globalnaya elektroenergetik	-0,001504	-0,001023	-0,000481	-0,000862	-0,000643
alfakapital elektroenergetika	-0,000826	-0,000658	-0,000167	-0,000555	-0,000271
rajffajzen elektroenergetika	-0,000933	-0,000834	-0,000099	-0,000700	-0,000233
interfin elektroenergetika	-0,000830	-0,000742	-0,000088	-0,000630	-0,000201
pallada energetika	-0,000810	-0,000732	-0,000077	-0,000611	-0,000199
bks aktualnye idei	-0,000581	-0,000528	-0,000052	-0,000465	-0,000115
rgs elektroenergetika	-0,000770	-0,000749	-0,000021	-0,000652	-0,000118
stoik metallurgiya i mashinostroeni	-0,000709	-0,000807	0,000098	-0,000687	-0,000022
baltinvest fond algoritmik	-0,000709	-0,000812	0,000104	-0,000681	-0,000027
otkrytie agressivnyj	-0,000715	-0,000822	0,000106	-0,000707	-0,000008
CAPM
merkuri globalnaya elektroenergetik	-0,001506	-0,001008	-0,000498	-0,000839	-0,000667
interfin elektroenergetika	-0,000816	-0,000681	-0,000135	-0,000590	-0,000226
alfakapital elektroenergetika	-0,000820	-0,000695	-0,000125	-0,000582	-0,000238
rgs elektroenergetika	-0,000775	-0,000740	-0,000035	-0,000620	-0,000156
pallada energetika	-0,000762	-0,000737	-0,000025	-0,000615	-0,000147
bks aktualnye idei	-0,000577	-0,000566	-0,000011	-0,000475	-0,000102
rajffajzen elektroenergetika	-0,000890	-0,000920	0,000031	-0,000728	-0,000161
maksvell energo	-0,000506	-0,000616	0,000110	-0,000504	-0,000002
otkrytie agressivnyj	-0,000732	-0,000868	0,000136	-0,000707	-0,000025
2209 obs Brent and Rub
merkuri globalnaya elektroenergetik	-0,001502	-0,000601	-0,000901	-	-
otkrytie agressivnyj	-0,000621	-0,000326	-0,000295	-	-
interfin elektroenergetika	-0,000785	-0,000570	-0,000215	-	-
alfakapital elektroenergetika	-0,000800	-0,000621	-0,000179	-	-
gorizont aktsii plyus khedzh	-0,000503	-0,000356	-0,000148	-	-
rajffajzen elektroenergetika	-0,000888	-0,000746	-0,000141	-	-
pallada energetika	-0,000800	-0,000687	-0,000112	-	-
rgs elektroenergetika	-0,000725	-0,000617	-0,000109	-	-
bks aktualnye idei	-0,000564	-0,000484	-0,000080	-	-
baltinvest fond algoritmik	-0,000683	-0,000605	-0,000078	-	-
baltinvest fond elektroenergetiki	-0,000817	-0,000776	-0,000041	-	-
stoik metallurgiya i mashinostroeni	-0,000662	-0,000632	-0,000030	-	-
stoik elektroenergetika	-0,000708	-0,000706	-0,000002	-	-

The most valuable information in these tables is in the column Difference. It represents how much higher the real alpha of a fund is above the border. For table with positive skill is used the top border, for negative skill - bottom. The higher the value Difference is - the better for all funds. The data in the table is sorted by the difference between real alpha and critical value for 5% significance level of initial H0 that claims random returns for a fund. As it can be seen from the tables the funds with positive and negative skills are mostly the same for three different models. But their ranking differs. The funds that have lower rank with 5% significance level probably have high standard deviation of residuals, meaning that there is much difference between percentiles. The negative skill results for model with 2209 observations of pseudo residuals for all funds have includes all negative skill funds from other models with 10% significance level and add one more. It can mean that this method of dealing with pseudo residuals can be applied and its results can be taken into consideration.

According to the tables above the best funds are “sberbank globalnyj internet” and “interfin telekom”. The funds that destroy their value the most: “merkuri globalnaya elektroenergetik”, “interfin elektroenergetika”, “alfakapital elektroenergetika”, “pallada energetika”, “bks aktualnye idei”. More results with detailed information and economic point of view can be found in the next chapter “Results”.

Synthetic portfolio approach has similar to bootstrap idea: to create a huge number of random portfolios without skill. But if bootstrap is based on econometrics, synthetic portfolio approach relies more on economic point of view. The last tries to simulate fund`s activity but with an assumption of zero skill usage. Synthetic portfolio approach in its basic form mentioned by D. Muravyev generates alphas for random portfolios based on one sample. There are differences in number of observations for different funds and thus dome funds have different distribution of luck, but most funds have the maximum and the same length. In general most distributions of luck provided by these simulated funds` alphas are the same and represents the whole market. Then by comparing a certain fund`s real alpha with this distribution the conclusion on fund`s skill is made. But doing so means the bigger alpha the better, which is not a new statement. Since the distribution of simulated alphas is the same for all the funds, the same will go for critical value. It only gives the point from which real alphas are considered skillful. The steps to conduct this approach in the way described above are presented below.

a) Create a sample of stocks that will be used to create portfolios. In basic version it consists of only most liquid stocks from Moscow exchange;

b) Pick randomly from 8 to 20 of stocks from step “a” as assets for one random portfolio;

c) Alongside with picking stocks their weights should be randomized from 5% to 12,5% in portfolio. The maximum value is 12,5% because of law in Russia for equity funds (Russian Federal Financial Market Service, available at: http://www.consultant.ru/document/cons_doc_LAW_115758/?frame=1#). According to it a fund cannot have more than 15% of its assets in one company`s shares. Since the portfolio is passive there is 2,5% in reserve in case of great changes in share prices. Also, there is no point in diversifying portfolios too much: no more than 20 companies and no less than 5% of weight;

d) When random portfolio is created, it is assumed that the trades are made on the first day of initial time period for each real fund. The longest for this research is from 11 of January 2005. Then daily returns for such portfolio are calculate throughout the whole period - up to 31 of December 2013;

e) These returns are used in the regression and alpha for one random portfolio is estimated;

f) Repeating steps from “b” to “e” a huge number of times will bring out a series of simulated alphas. Their distribution is distribution of luck for the whole market;

g) To make a decision on fund`s skill its alpha should be compared with critical value from luck distribution. For significance level of 5% fund`s alpha should be among 2,5% top alphas from simulated distribution.

There are two more assumptions: first, all the money each simulated fund has is invested in shares, second, each portfolio is passive, meaning no trades during the whole period. The presented above form of synthetic portfolio approach does not take into consideration unique features of funds. There are funds that have different number of observations (this factor is included) and also different risk factor. A more suitable and representative way to use this approach is to create unique simulated distribution of alphas for each fund. Each fund has its own specification: some invest in a certain industry, others are concentrated on companies' value and etc. For each fund or at least group of funds unique sample should be chosen. The day a simulated portfolio is opened matches the day of first observation of the tested fund. In this way the distribution of simulated alphas will differ for different funds. Then the greater real alpha may not necessarily mean skill. The plan for new form of synthetic portfolio approach:

a) Choose a real fund to test its skill;

b) According to the chosen fund`s specification choose stocks that will form a sample for simulations;

c) Pick randomly from 8 to 20 companies in the sample and match their weights from 5% to 12,5%;

d) Estimate returns for random portfolio. The first date should match that of a real fund. If a real fund has be operating for 3 years, then the simulated portfolio is also 3 years old;

e) Regress the returns to get simulated alpha;

f) Repeat steps from “c” to “e” to create many random portfolios and estimate their alphas;

g) Compare real fund`s alpha with simulated distribution, make a conclusion.

In this form the approach is very time-consuming: each fund should be analyzed separately. It is because fund`s specification has to be taken into account. The approach also needs a lot of data collection and the last one should be properly prepared: download prices for many stocks, match the date for all of them (some funds invest in assets with low liquidity, which brings problems with data availability). Thus this approach is better suited to check the decision on already chosen funds. Synthetic portfolio approach is not implemented in this research as the last is concentrated on bootstrap approach that has similar idea behind its methods.

Results

The bootstrap approach used in this research has several models and different methods of treating pseudo residuals. Each of the models and methods have its own results for evidence of skill for funds` managers. The results first should be analyzed and compared, then combined. The final results should have strong support from economic point of view. To achieve this goal can be used the following plan:

a) There is no need to inspect results for all models since they are practically the same. It will be enough to create the sample of all the skilled funds from all models and analyze them only by one model. Since all specifications are similar to each other, the model with Brent oil and USD/RUB can be used for this task. This model has higher r-squared for all funds compared to CAPM and for 174 from 175 funds compared to Brent oil in rubles model. The two other models were needed to outline more funds with skill, that can be then included in the main model sample;

b) To filter the resulted funds their regressions should be analyzed and compared with fund specialization, funds that have been tested with not appropriate models are excluded;

c) The rest of the funds are ranked and if the difference between real alpha and critical value is low and the fund is not assumed as skilled (positive or negative) by some of the models then such fund is excluded;

d) The results are weighted and combined to form the final sample of funds with nonrandom returns.

The sample of skilled funds was united and now consists of 4 funds with positive skill and 13 - with negative. As the second step suggests funds coefficients and r-squared for all models should be analyzed. But since Brent and rub model`s r-squared is higher for all funds there is no need to consider other two models in this step. The initial sample also includes funds that invest in foreign assets, commodities, funds and etc. All the models in this research are based on CAPM with the benchmark for Russian market. Such models can be inappropriate for skill estimation with the use of regression alphas. Because if all beta coefficients are close to zero alpha will be around mean returns. Then in the process of creating pseudo returns with zero alpha these new returns will be based solely on new residuals. The mean value of these residuals will be the alpha of regression for pseudo returns. But mean value of residuals usually cannot compete with mean value of returns if the last are not that close to zero. The situation is change a bit when pseudo residuals are created with possibility to replace observations. In such case the mean value of new series of residuals can have significant differences with zero. But the whole process is still based on mean values of returns and residuals for such situation. The results for such funds cannot be trusted. Thus it can be logical to exclude funds with r-squared or all betas in the model close to zero. Skilled funds from all models have their coefficients with Brent oil and USD/RUB model presented in Table 15.

Table 15

Skilled funds coefficients from Brent oil and USD/RUB model.

Fund	Real Alpha	Beta1	Beta2	Beta3	r-squared	difference
positive skill
interfin telekom	0,000481	0,250983	0,010014	-0,171097	0,185027	-0,000027
sberbank globalnyj internet	0,000412	0,356259	0,196270	0,111671	0,348501	-0,000032
univer fond aktsij	0,000670	0,368263	-0,020394	-0,250801	0,378309	-0,000043
tkb bnp pariba perspektivnye investitsii	0,002040	0,240665	-0,019741	0,157347	0,008413	-0,000518
negative skill
merkuri globalnaya elektroenergetik	-0,001502	0,092287	-0,014270	0,042210	0,008051	-0,000570
alfakapital elektroenergetika	-0,000800	0,297631	0,037848	-0,289495	0,246223	-0,000182
pallada energetika	-0,000800	0,178246	0,101180	-0,119819	0,102483	-0,000103
interfin elektroenergetika	-0,000785	0,292646	0,058219	-0,303313	0,264359	-0,000037
rajffajzen elektroenergetika	-0,000888	0,244048	0,098989	-0,242537	0,148646	-0,000034
bks aktualnye idei	-0,000564	0,054654	0,021928	-0,142310	0,027440	-0,000004
rgs elektroenergetika	-0,000725	0,386006	0,028357	-0,336945	0,322784	0,000053
stoik metallurgiya i mashinostroeni	-0,000662	0,165474	0,118902	-0,180615	0,128909	0,000126
gorizont aktsii plyus khedzh	-0,000503	0,281542	0,007062	-0,086302	0,196846	0,000156
baltinvest fond elektroenergetiki	-0,000817	0,235757	0,080159	-0,160112	0,114874	0,000156
baltinvest fond algoritmik	-0,000683	0,223571	0,074830	-0,099716	0,142462	0,000167
otkrytie agressivnyj	-0,000621	-0,021452	-0,082782	-0,477950	0,112439	0,000170
stoik elektroenergetika	-0,000708	0,217176	0,092609	-0,104723	0,128418	0,000204

The column Difference is estimated by subtraction critical value of the closest border from real alpha. All the coefficients and values from column Difference are estimated with Brent oil and USD/RUB model. Since currency is less volatile returns or changes from USD/RUB are smaller than funds` returns. Thus beta with this factor should be higher to influence returns and the model. From positive skill funds “tkb bnp pariba perspektivnye investitsii” should be excluded as it has r-squared less than 0,01. “Merkuri globalnaya elektroenergetik” and “bks aktualnye idei” are also excluded because of both low r-squared (less than 0,1) and betas close to zero. Fund “baltinvest fond algoritmik” is considered to have negative skill only by Brent in rubles model on 10% significance level (model with 2209 observations is not mentioned as it has all the funds from other models), on 5% level it is pretty far away from the border. It also has low r-squared (below 0,15). Thus this fund is excluded too. Similar situation is with “stoik elektroenergetika” (it also has the lowest negative skills according to model with full-length residuals), “stoik metallurgiya i mashinostroeni” and “baltinvest fond elektroenergetiki”. Even though “otkrytie agressivnyj” has low r-squared (it is at least above 0,1) two out of three models claims this fund to have negative skills and model with full-length residuals place this fund among the top with negative skill. It also invests in Russian companies listed on Moex. That is why the fund is still in the sample. Other funds have r-squared lower than 0,2, but since they invest in Russian market and models suggests that they have skills funds are not excluded. Fund “sberbank globalnyj internet” invests in foreign assets and have only 8,23% in stocks on Moex, but the assets with biggest percentages are Russian companies traded on NASDAQ. That is why this fund has relatively high r-squared and betas and it is not excluded. The final sample of skilled funds for bootstrap approach consists of three funds with nonrandom positive returns and 7 with nonrandom negative returns. These funds will be presented later.

After bootstrap approach brings out results the funds should be compared with other statistics and coefficients for performance measurement used by economists and investors. They are: mean and Jensen alpha, Sharpe ratio and Sortino ratio, 1-year and 3-years returns. All of them are estimated on daily data. The model specification for real alpha and “difference” contains Brent oil and USD/RUB. Bootstrap results are tested by other statistics on Table 16.

Table 16

Skilled funds statistics and coefficients.

Fund	Mean	Real Alpha	Sharpe R	Sortino R	1-year	3-year	difference
positive skill
interfin telekom	0,000784	0,000481	0,039406	0,058290	12,03%	25,23%	-0,000027
sberbank globalnyj internet	0,000839	0,000412	0,054714	0,081475	53,74%	NA	-0,000032
univer fond aktsij	0,000727	0,000670	0,034687	0,050100	2,30%	-19,21%	-0,000043
negative skill
alfakapital elektroenergetika	-0,000605	-0,000800	-0,052431	-0,069610	-45,01%	-70,65%	-0,000182
pallada energetika	-0,000524	-0,000800	-0,043575	-0,057225	-36,61%	-66,40%	-0,000103
interfin elektroenergetika	-0,000596	-0,000785

Подобные документы

• Financial institutions

  The concept, types and regulation of financial institutions. Their main functions: providing insurance and loans, asset swaps market participants. Activities and basic operations of credit unions, brokerage firms, investment funds and mutual funds.
  
  реферат [14,0 K], добавлен 01.12.2010
  

• Off-budget funds - their place in a financial system

  Economic essence of off-budget funds, the reasons of their occurrence. Pension and insurance funds. National fund of the Republic of Kazakhstan. The analysis of directions and results of activity of off-budget funds. Off-budget funds of local controls.
  
  курсовая работа [29,4 K], добавлен 21.10.2013
  

• The Global Money Markets and Money Management

  The General Economic Conditions for the Use of Money. Money and Money Substitutes. The Global Money Markets. US Money Market. Money Management. Cash Management for Finance Managers. The activity of financial institutions in the money market involves.
  
  реферат [20,9 K], добавлен 01.12.2006
  

• Foreign investments in Russian economy

  Strategy of foreign capital regulation in Russia. Russian position in the world market of investments. Problems of foreign investments attraction. Types of measures for attraction of investments. Main aspects of foreign investments attraction policy.
  
  реферат [20,8 K], добавлен 16.05.2011
  

• Accumulation Pension Funds: condition and development

  Theoretical aspects of accumulation pension system. Analysis of current status and development of accumulative pension system in Kazakhstan. Ways to improve the pension system and enhancing its social significance accumulative pension fund provision.
  
  курсовая работа [1,1 M], добавлен 06.11.2013
  

• A balance sheet

  Тhe balance sheet company's financial condition is divided into 2 kinds: personal and corporate. Each of these species has some characteristics and detail information about the assets, liabilities and provided shareholders' equity of the company.
  
  реферат [409,2 K], добавлен 25.12.2008
  

• Specificity exchange market

  Types and functions exchange. Conjuncture of exchange market in theory. The concept of the exchange. Types of Exchanges and Exchange operations. The concept of market conditions, goals, and methods of analysis. Stages of market research product markets.
  
  курсовая работа [43,3 K], добавлен 08.02.2014
  

• Capital market

  Capital Structure Definition. Trade-off theory explanation to determine the capital structure. Common factors having most impact on firm’s capital structure in retail sector. Analysis the influence they have on the listed firm’s debt-equity ratio.
  
  курсовая работа [144,4 K], добавлен 16.07.2016
  

• Улучшение показателей ликвидности предприятия ПАО Мегафон

  Методы и показатели оценки ликвидности. Разделение актива и пассива баланса по степени ликвидности. Абсолютные и относительные показатели ликвидности. Повышение ликвидности за счет автоматизации бюджетирования и с помощью продуктов Cash Management.
  
  дипломная работа [2,6 M], добавлен 26.06.2017
  

• To investigate a credit channel of monetary policy transmission

  Study credit channel using clustering and test the difference in mean portfolio returns. The calculated debt-to-capital, interest coverage, current ratio, payables turnover ratio. Analysis of stock market behavior. Comparison of portfolios’ performances.
  
  курсовая работа [1,5 M], добавлен 23.10.2016
  

• главная
• рубрики
• по алфавиту
• вернуться в начало страницы
• вернуться к началу текста
• вернуться к подобным работам