By clicking Accept all cookies, you agree Stack Exchange can store cookies on your device and disclose information in accordance with our Cookie Policy. For reasons of simplicity I propose a simple t-test (welche two sample t-test). Correlation tests check whether variables are related without hypothesizing a cause-and-effect relationship. The problem is that, despite randomization, the two groups are never identical. Comparing the mean difference between data measured by different equipment, t-test suitable? (i.e. 0000066547 00000 n What is the difference between discrete and continuous variables? Non-parametric tests dont make as many assumptions about the data, and are useful when one or more of the common statistical assumptions are violated. Each individual is assigned either to the treatment or control group and treated individuals are distributed across four treatment arms. Where G is the number of groups, N is the number of observations, x is the overall mean and xg is the mean within group g. Under the null hypothesis of group independence, the f-statistic is F-distributed. For most visualizations, I am going to use Pythons seaborn library. 0000023797 00000 n When it happens, we cannot be certain anymore that the difference in the outcome is only due to the treatment and cannot be attributed to the imbalanced covariates instead. determine whether a predictor variable has a statistically significant relationship with an outcome variable. In each group there are 3 people and some variable were measured with 3-4 repeats. One possible solution is to use a kernel density function that tries to approximate the histogram with a continuous function, using kernel density estimation (KDE). tick the descriptive statistics and estimates of effect size in display. Unfortunately, the pbkrtest package does not apply to gls/lme models. There is also three groups rather than two: In response to Henrik's answer: Interpret the results. Thank you for your response. 0000045868 00000 n As we can see, the sample statistic is quite extreme with respect to the values in the permuted samples, but not excessively. For testing, I included the Sales Region table with relationship to the fact table which shows that the totals for Southeast and Southwest and for Northwest and Northeast match the Selected Sales Region 1 and Selected Sales Region 2 measure totals. We can now perform the test by comparing the expected (E) and observed (O) number of observations in the treatment group, across bins. In the experiment, segment #1 to #15 were measured ten times each with both machines. They can be used to test the effect of a categorical variable on the mean value of some other characteristic. 0000002315 00000 n Is it a bug? A - treated, B - untreated. 4 0 obj << Example Comparing Positive Z-scores. . They are as follows: Step 1: Make the consequent of both the ratios equal - First, we need to find out the least common multiple (LCM) of both the consequent in ratios. If I am less sure about the individual means it should decrease my confidence in the estimate for group means. An alternative test is the MannWhitney U test. I have run the code and duplicated your results. For example, let's use as a test statistic the difference in sample means between the treatment and control groups. I'm asking it because I have only two groups. F If you already know what types of variables youre dealing with, you can use the flowchart to choose the right statistical test for your data. Males and . By clicking Post Your Answer, you agree to our terms of service, privacy policy and cookie policy. Secondly, this assumes that both devices measure on the same scale. Lets have a look a two vectors. 'fT Fbd_ZdG'Gz1MV7GcA`2Nma> ;/BZq>Mp%$yTOp;AI,qIk>lRrYKPjv9-4%hpx7 y[uHJ bR' There are two steps to be remembered while comparing ratios. Excited to share the good news, you tell the CEO about the success of the new product, only to see puzzled looks. Choose the comparison procedure based on the group means that you want to compare, the type of confidence level that you want to specify, and how conservative you want the results to be. In the last column, the values of the SMD indicate a standardized difference of more than 0.1 for all variables, suggesting that the two groups are probably different. >j It only takes a minute to sign up. I have a theoretical problem with a statistical analysis. In the photo above on my classroom wall, you can see paper covering some of the options. I don't have the simulation data used to generate that figure any longer. Did any DOS compatibility layers exist for any UNIX-like systems before DOS started to become outmoded? The four major ways of comparing means from data that is assumed to be normally distributed are: Independent Samples T-Test. ]Kd\BqzZIBUVGtZ$mi7[,dUZWU7J',_"[tWt3vLGijIz}U;-Y;07`jEMPMNI`5Q`_b2FhW$n Fb52se,u?[#^Ba6EcI-OP3>^oV%b%C-#ac} This is a classical bias-variance trade-off. In the text box For Rows enter the variable Smoke Cigarettes and in the text box For Columns enter the variable Gender. What is the point of Thrower's Bandolier? rev2023.3.3.43278. If the value of the test statistic is less extreme than the one calculated from the null hypothesis, then you can infer no statistically significant relationship between the predictor and outcome variables. z mmm..This does not meet my intuition. By default, it also adds a miniature boxplot inside. If the distributions are the same, we should get a 45-degree line. dPW5%0ndws:F/i(o}#7=5yQ)ngVnc5N6]I`>~ However, an important issue remains: the size of the bins is arbitrary. Conceptual Track.- Effect of Synthetic Emotions on Agents' Learning Speed and Their Survivability.- From the Inside Looking Out: Self Extinguishing Perceptual Cues and the Constructed Worlds of Animats.- Globular Universe and Autopoietic Automata: A . Imagine that a health researcher wants to help suffers of chronic back pain reduce their pain levels. How to compare two groups with multiple measurements for each individual with R? Goals. H a: 1 2 2 2 < 1. I would like to compare two groups using means calculated for individuals, not measure simple mean for the whole group. Resources and support for statistical and numerical data analysis, This table is designed to help you choose an appropriate statistical test for data with, Hover your mouse over the test name (in the. There are multiple issues with this plot: We can solve the first issue using the stat option to plot the density instead of the count and setting the common_norm option to False to normalize each histogram separately. We discussed the meaning of question and answer and what goes in each blank. We thank the UCLA Institute for Digital Research and Education (IDRE) for permission to adapt and distribute this page from our site. There are some differences between statistical tests regarding small sample properties and how they deal with different variances. @Flask I am interested in the actual data. 0000048545 00000 n 1xDzJ!7,U&:*N|9#~W]HQKC@(x@}yX1SA pLGsGQz^waIeL!`Mc]e'Iy?I(MDCI6Uqjw r{B(U;6#jrlp,.lN{-Qfk4>H 8`7~B1>mx#WG2'9xy/;vBn+&Ze-4{j,=Dh5g:~eg!Bl:d|@G Mdu] BT-\0OBu)Ni_0f0-~E1 HZFu'2+%V!evpjhbh49 JF Since we generated the bins using deciles of the distribution of income in the control group, we expect the number of observations per bin in the treatment group to be the same across bins. 0000001155 00000 n If your data do not meet the assumption of independence of observations, you may be able to use a test that accounts for structure in your data (repeated-measures tests or tests that include blocking variables). Do you want an example of the simulation result or the actual data? For each one of the 15 segments, I have 1 real value, 10 values for device A and 10 values for device B, Two test groups with multiple measurements vs a single reference value, s22.postimg.org/wuecmndch/frecce_Misuraz_001.jpg, We've added a "Necessary cookies only" option to the cookie consent popup. In the first two columns, we can see the average of the different variables across the treatment and control groups, with standard errors in parenthesis. The same 15 measurements are repeated ten times for each device. Nevertheless, what if I would like to perform statistics for each measure? finishing places in a race), classifications (e.g. Computation of the AQI requires an air pollutant concentration over a specified averaging period, obtained from an air monitor or model.Taken together, concentration and time represent the dose of the air pollutant. In the Data Modeling tab in Power BI, ensure that the new filter tables do not have any relationships to any other tables. What is a word for the arcane equivalent of a monastery? trailer << /Size 40 /Info 16 0 R /Root 19 0 R /Prev 94565 /ID[<72768841d2b67f1c45d8aa4f0899230d>] >> startxref 0 %%EOF 19 0 obj << /Type /Catalog /Pages 15 0 R /Metadata 17 0 R /PageLabels 14 0 R >> endobj 38 0 obj << /S 111 /L 178 /Filter /FlateDecode /Length 39 0 R >> stream How to compare two groups of empirical distributions? Background. 5 Jun. To control for the zero floor effect (i.e., positive skew), I fit two alternative versions transforming the dependent variable either with sqrt for mild skew and log for stronger skew. If the value of the test statistic is more extreme than the statistic calculated from the null hypothesis, then you can infer a statistically significant relationship between the predictor and outcome variables. Quantitative variables are any variables where the data represent amounts (e.g. Take a look at the examples below: Example #1. As noted in the question I am not interested only in this specific data. The boxplot scales very well when we have a number of groups in the single-digits since we can put the different boxes side-by-side. Acidity of alcohols and basicity of amines. Has 90% of ice around Antarctica disappeared in less than a decade? In this post, we have seen a ton of different ways to compare two or more distributions, both visually and statistically. ncdu: What's going on with this second size column? [6] A. N. Kolmogorov, Sulla determinazione empirica di una legge di distribuzione (1933), Giorn. The choroidal vascularity index (CVI) was defined as the ratio of LA to TCA. Cross Validated is a question and answer site for people interested in statistics, machine learning, data analysis, data mining, and data visualization. Statistical significance is a term used by researchers to state that it is unlikely their observations could have occurred under the null hypothesis of a statistical test. Use the independent samples t-test when you want to compare means for two data sets that are independent from each other. Visual methods are great to build intuition, but statistical methods are essential for decision-making since we need to be able to assess the magnitude and statistical significance of the differences. 3G'{0M;b9hwGUK@]J< Q [*^BKj^Xt">v!(,Ns4C!T Q_hnzk]f Jasper scored an 86 on a test with a mean of 82 and a standard deviation of 1.8. Site design / logo 2023 Stack Exchange Inc; user contributions licensed under CC BY-SA. %PDF-1.4 I will need to examine the code of these functions and run some simulations to understand what is occurring. It seems that the income distribution in the treatment group is slightly more dispersed: the orange box is larger and its whiskers cover a wider range. Volumes have been written about this elsewhere, and we won't rehearse it here. So far, we have seen different ways to visualize differences between distributions. What Is the Difference Between 'Man' And 'Son of Man' in Num 23:19? When the p-value falls below the chosen alpha value, then we say the result of the test is statistically significant. One-way ANOVA however is applicable if you want to compare means of three or more samples. What's the difference between a power rail and a signal line? In particular, in causal inference, the problem often arises when we have to assess the quality of randomization. MathJax reference. For example, we could compare how men and women feel about abortion. (b) The mean and standard deviation of a group of men were found to be 60 and 5.5 respectively. Calculate a 95% confidence for a mean difference (paired data) and the difference between means of two groups (2 independent . Thanks for contributing an answer to Cross Validated! The data looks like this: And I have run some simulations using this code which does t tests to compare the group means. One solution that has been proposed is the standardized mean difference (SMD). Sir, please tell me the statistical technique by which I can compare the multiple measurements of multiple treatments. The colors group statistical tests according to the key below: Choose Statistical Test for 1 Dependent Variable, Choose Statistical Test for 2 or More Dependent Variables, Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License. We will use the Repeated Measures ANOVA Calculator using the following input: Once we click "Calculate" then the following output will automatically appear: Step 3. %H@%x YX>8OQ3,-p(!LlA.K= Otherwise, register and sign in. one measurement for each). You can imagine two groups of people. This is a primary concern in many applications, but especially in causal inference where we use randomization to make treatment and control groups as comparable as possible. If you've already registered, sign in. The intuition behind the computation of R and U is the following: if the values in the first sample were all bigger than the values in the second sample, then R = n(n + 1)/2 and, as a consequence, U would then be zero (minimum attainable value). Ignore the baseline measurements and simply compare the nal measurements using the usual tests used for non-repeated data e.g. 0000004417 00000 n The Q-Q plot plots the quantiles of the two distributions against each other. Background: Cardiovascular and metabolic diseases are the leading contributors to the early mortality associated with psychotic disorders. estimate the difference between two or more groups. Lets start with the simplest setting: we want to compare the distribution of income across the treatment and control group. Just look at the dfs, the denominator dfs are 105. My goal with this part of the question is to understand how I, as a reader of a journal article, can better interpret previous results given their choice of analysis method. 37 63 56 54 39 49 55 114 59 55. The ANOVA provides the same answer as @Henrik's approach (and that shows that Kenward-Rogers approximation is correct): Then you can use TukeyHSD() or the lsmeans package for multiple comparisons: Thanks for contributing an answer to Cross Validated! )o GSwcQ;u VDp\>!Y.Eho~`#JwN 9 d9n_ _Oao!`-|g _ C.k7$~'GsSP?qOxgi>K:M8w1s:PK{EM)hQP?qqSy@Q;5&Q4. Use an unpaired test to compare groups when the individual values are not paired or matched with one another. Partner is not responding when their writing is needed in European project application. Minimising the environmental effects of my dyson brain, Recovering from a blunder I made while emailing a professor, Short story taking place on a toroidal planet or moon involving flying, Acidity of alcohols and basicity of amines, Calculating probabilities from d6 dice pool (Degenesis rules for botches and triggers). Replacing broken pins/legs on a DIP IC package, Is there a solutiuon to add special characters from software and how to do it. Paired t-test. Only two groups can be studied at a single time. The region and polygon don't match. The multiple comparison method. A t -test is used to compare the means of two groups of continuous measurements. %\rV%7Go7 It seems that the model with sqrt trasnformation provides a reasonable fit (there still seems to be one outlier, but I will ignore it). Example of measurements: Hemoglobin, Troponin, Myoglobin, Creatinin, C reactive Protein (CRP) This means I would like to see a difference between these groups for different Visits, e.g. Hence I fit the model using lmer from lme4. We will later extend the solution to support additional measures between different Sales Regions. ANOVA and MANOVA tests are used when comparing the means of more than two groups (e.g., the average heights of children, teenagers, and adults). Previous literature has used the t-test ignoring within-subject variability and other nuances as was done for the simulations above. To open the Compare Means procedure, click Analyze > Compare Means > Means. You conducted an A/B test and found out that the new product is selling more than the old product. The goal of this study was to evaluate the effectiveness of t, analysis of variance (ANOVA), Mann-Whitney, and Kruskal-Wallis tests to compare visual analog scale (VAS) measurements between two or among three groups of patients. Connect and share knowledge within a single location that is structured and easy to search. Do the real values vary? What am I doing wrong here in the PlotLegends specification? One simple method is to use the residual variance as the basis for modified t tests comparing each pair of groups. Use MathJax to format equations. Now, try to you write down the model: $y_{ijk} = $ where $y_{ijk}$ is the $k$-th value for individual $j$ of group $i$. The Kolmogorov-Smirnov test is probably the most popular non-parametric test to compare distributions. H a: 1 2 2 2 1. Randomization ensures that the only difference between the two groups is the treatment, on average, so that we can attribute outcome differences to the treatment effect. Use a multiple comparison method. However, we might want to be more rigorous and try to assess the statistical significance of the difference between the distributions, i.e. You can find the original Jupyter Notebook here: I really appreciate it! In order to get multiple comparisons you can use the lsmeans and the multcomp packages, but the $p$-values of the hypotheses tests are anticonservative with defaults (too high) degrees of freedom. The asymptotic distribution of the Kolmogorov-Smirnov test statistic is Kolmogorov distributed. Click OK. Click the red triangle next to Oneway Analysis, and select UnEqual Variances. Types of quantitative variables include: Categorical variables represent groupings of things (e.g. Table 1: Weight of 50 students. We can choose any statistic and check how its value in the original sample compares with its distribution across group label permutations. For example, in the medication study, the effect is the mean difference between the treatment and control groups. Create the 2 nd table, repeating steps 1a and 1b above. Discrete and continuous variables are two types of quantitative variables: If you want to cite this source, you can copy and paste the citation or click the Cite this Scribbr article button to automatically add the citation to our free Citation Generator. Predictor variable. Darling, Asymptotic Theory of Certain Goodness of Fit Criteria Based on Stochastic Processes (1953), The Annals of Mathematical Statistics. We will use two here. With multiple groups, the most popular test is the F-test. We can now perform the actual test using the kstest function from scipy. The alternative hypothesis is that there are significant differences between the values of the two vectors. Stack Exchange network consists of 181 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers. Firstly, depending on how the errors are summed the mean could likely be zero for both groups despite the devices varying wildly in their accuracy. Learn more about Stack Overflow the company, and our products. Distribution of income across treatment and control groups, image by Author. @StphaneLaurent I think the same model can only be obtained with. For this approach, it won't matter whether the two devices are measuring on the same scale as the correlation coefficient is standardised. plt.hist(stats, label='Permutation Statistics', bins=30); Chi-squared Test: statistic=32.1432, p-value=0.0002, k = np.argmax( np.abs(df_ks['F_control'] - df_ks['F_treatment'])), y = (df_ks['F_treatment'][k] + df_ks['F_control'][k])/2, Kolmogorov-Smirnov Test: statistic=0.0974, p-value=0.0355. Again, the ridgeline plot suggests that higher numbered treatment arms have higher income. endstream endobj 30 0 obj << /Type /Font /Subtype /TrueType /FirstChar 32 /LastChar 122 /Widths [ 278 0 0 0 0 0 0 0 0 0 0 0 0 333 0 278 0 556 0 556 0 0 0 0 0 0 333 0 0 0 0 0 0 722 722 722 722 0 0 778 0 0 0 722 0 833 0 0 0 0 0 0 0 722 0 944 0 0 0 0 0 0 0 0 0 556 611 556 611 556 333 611 611 278 0 556 278 889 611 611 611 611 389 556 333 611 556 778 556 556 500 ] /Encoding /WinAnsiEncoding /BaseFont /KNJKDF+Arial,Bold /FontDescriptor 31 0 R >> endobj 31 0 obj << /Type /FontDescriptor /Ascent 905 /CapHeight 0 /Descent -211 /Flags 32 /FontBBox [ -628 -376 2034 1010 ] /FontName /KNJKDF+Arial,Bold /ItalicAngle 0 /StemV 133 /XHeight 515 /FontFile2 36 0 R >> endobj 32 0 obj << /Filter /FlateDecode /Length 18615 /Length1 32500 >> stream [2] F. Wilcoxon, Individual Comparisons by Ranking Methods (1945), Biometrics Bulletin. One which is more errorful than the other, And now, lets compare the measurements for each device with the reference measurements. The best answers are voted up and rise to the top, Not the answer you're looking for? If that's the case then an alternative approach may be to calculate correlation coefficients for each device-real pairing, and look to see which has the larger coefficient. This flowchart helps you choose among parametric tests. A complete understanding of the theoretical underpinnings and . Different test statistics are used in different statistical tests. Use MathJax to format equations. Economics PhD @ UZH. We would like them to be as comparable as possible, in order to attribute any difference between the two groups to the treatment effect alone. whether your data meets certain assumptions. From the plot, we can see that the value of the test statistic corresponds to the distance between the two cumulative distributions at income~650. It describes how far your observed data is from thenull hypothesisof no relationship betweenvariables or no difference among sample groups. Below are the steps to compare the measure Reseller Sales Amount between different Sales Regions sets. The Tamhane's T2 test was performed to adjust for multiple comparisons between groups within each analysis. Let n j indicate the number of measurements for group j {1, , p}. When comparing three or more groups, the term paired is not apt and the term repeated measures is used instead. For that value of income, we have the largest imbalance between the two groups. from https://www.scribbr.com/statistics/statistical-tests/, Choosing the Right Statistical Test | Types & Examples. So if i accept 0.05 as a reasonable cutoff I should accept their interpretation? One Way ANOVA A one way ANOVA is used to compare two means from two independent (unrelated) groups using the F-distribution. Strange Stories, the most commonly used measure of ToM, was employed. In order to have a general idea about which one is better I thought that a t-test would be ok (tell me if not): I put all the errors of Device A together and compare them with B. In this case, we want to test whether the means of the income distribution are the same across the two groups. Stack Exchange network consists of 181 Q&A communities including Stack Overflow, the largest, most trusted online community for developers to learn, share their knowledge, and build their careers. The fundamental principle in ANOVA is to determine how many times greater the variability due to the treatment is than the variability that we cannot explain. aNWJ!3ZlG:P0:E@Dk3A+3v6IT+&l qwR)1 ^*tiezCV}}1K8x,!IV[^Lzf`t*L1[aha[NHdK^idn6I`?cZ-vBNe1HfA.AGW(`^yp=[ForH!\e}qq]e|Y.d\"$uG}l&+5Fuc Browse other questions tagged, Start here for a quick overview of the site, Detailed answers to any questions you might have, Discuss the workings and policies of this site. This ignores within-subject variability: Now, it seems to me that because each individual mean is an estimate itself, that we should be less certain about the group means than shown by the 95% confidence intervals indicated by the bottom-left panel in the figure above. Direct analysis of geological reference materials was performed by LA-ICP-MS using two Nd:YAG laser systems operating at 266 nm and 1064 nm. columns contain links with examples on how to run these tests in SPSS, Stata, SAS, R and MATLAB. You can perform statistical tests on data that have been collected in a statistically valid manner either through an experiment, or through observations made using probability sampling methods. However, the issue with the boxplot is that it hides the shape of the data, telling us some summary statistics but not showing us the actual data distribution. What is the difference between quantitative and categorical variables? So what is the correct way to analyze this data? The measurement site of the sphygmomanometer is in the radial artery, and the measurement site of the watch is the two main branches of the arteriole. What sort of strategies would a medieval military use against a fantasy giant? In practice, the F-test statistic is given by. If I want to compare A vs B of each one of the 15 measurements would it be ok to do a one way ANOVA? If you preorder a special airline meal (e.g. Significance test for two groups with dichotomous variable. Here we get: group 1 v group 2, P=0.12; 1 v 3, P=0.0002; 2 v 3, P=0.06. When comparing two groups, you need to decide whether to use a paired test. This question may give you some help in that direction, although with only 15 observations the differences in reliability between the two devices may need to be large before you get a significant $p$-value. February 13, 2013 . [3] B. L. Welch, The generalization of Students problem when several different population variances are involved (1947), Biometrika. Reply. Objectives: DeepBleed is the first publicly available deep neural network model for the 3D segmentation of acute intracerebral hemorrhage (ICH) and intraventricular hemorrhage (IVH) on non-enhanced CT scans (NECT). The study aimed to examine the one- versus two-factor structure and . Categorical. The test statistic is asymptotically distributed as a chi-squared distribution. The most intuitive way to plot a distribution is the histogram. A common type of study performed by anesthesiologists determines the effect of an intervention on pain reported by groups of patients. @Flask A colleague of mine, which is not mathematician but which has a very strong intuition in statistics, would say that the subject is the "unit of observation", and then only his mean value plays a role. Karen says. Under mild conditions, the test statistic is asymptotically distributed as a Student t distribution. Do new devs get fired if they can't solve a certain bug? 0000003544 00000 n The first experiment uses repeats. Because the variance is the square of . In this blog post, we are going to see different ways to compare two (or more) distributions and assess the magnitude and significance of their difference. Hb```V6Ad`0pT00L($\MKl]K|zJlv{fh` k"9:1p?bQ:?3& q>7c`9SA'v GW &020fbo w% endstream endobj 39 0 obj 162 endobj 20 0 obj << /Type /Page /Parent 15 0 R /Resources 21 0 R /Contents 29 0 R /MediaBox [ 0 0 612 792 ] /CropBox [ 0 0 612 792 ] /Rotate 0 >> endobj 21 0 obj << /ProcSet [ /PDF /Text ] /Font << /TT2 26 0 R /TT4 22 0 R /TT6 23 0 R /TT8 30 0 R >> /ExtGState << /GS1 34 0 R >> /ColorSpace << /Cs6 28 0 R >> >> endobj 22 0 obj << /Type /Font /Subtype /TrueType /FirstChar 32 /LastChar 121 /Widths [ 250 0 0 0 0 0 778 0 333 333 0 0 250 0 250 0 0 500 500 0 0 0 0 0 0 500 278 0 0 0 0 0 0 722 667 667 0 0 556 722 0 0 0 722 611 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 444 0 444 500 444 0 0 0 0 0 0 278 0 500 500 500 0 333 389 278 0 0 0 0 500 ] /Encoding /WinAnsiEncoding /BaseFont /KNJJNE+TimesNewRoman /FontDescriptor 24 0 R >> endobj 23 0 obj << /Type /Font /Subtype /TrueType /FirstChar 32 /LastChar 118 /Widths [ 250 0 0 0 0 0 0 0 0 0 0 0 0 0 250 0 0 0 0 0 0 0 0 0 0 0 333 0 0 0 0 0 0 611 0 0 0 0 0 0 0 333 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 500 0 444 500 444 0 500 500 278 0 0 0 722 500 500 0 0 389 389 278 500 444 ] /Encoding /WinAnsiEncoding /BaseFont /KNJKAF+TimesNewRoman,Italic /FontDescriptor 27 0 R >> endobj 24 0 obj << /Type /FontDescriptor /Ascent 891 /CapHeight 0 /Descent -216 /Flags 34 /FontBBox [ -568 -307 2028 1007 ] /FontName /KNJJNE+TimesNewRoman /ItalicAngle 0 /StemV 0 /FontFile2 32 0 R >> endobj 25 0 obj << /Type /FontDescriptor /Ascent 905 /CapHeight 718 /Descent -211 /Flags 32 /FontBBox [ -665 -325 2028 1006 ] /FontName /KNJJKD+Arial /ItalicAngle 0 /StemV 94 /XHeight 515 /FontFile2 33 0 R >> endobj 26 0 obj << /Type /Font /Subtype /TrueType /FirstChar 32 /LastChar 146 /Widths [ 278 0 0 0 0 0 0 0 333 333 0 0 278 333 278 278 0 556 556 556 556 556 0 556 0 0 278 278 0 0 0 0 0 667 667 722 722 0 611 0 0 278 0 0 556 833 722 778 0 0 722 667 611 0 667 944 667 0 0 0 0 0 0 0 0 556 556 500 556 556 278 556 556 222 0 500 222 833 556 556 556 556 333 500 278 556 500 722 500 500 500 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 222 ] /Encoding /WinAnsiEncoding /BaseFont /KNJJKD+Arial /FontDescriptor 25 0 R >> endobj 27 0 obj << /Type /FontDescriptor /Ascent 891 /CapHeight 0 /Descent -216 /Flags 98 /FontBBox [ -498 -307 1120 1023 ] /FontName /KNJKAF+TimesNewRoman,Italic /ItalicAngle -15 /StemV 83.31799 /FontFile2 37 0 R >> endobj 28 0 obj [ /ICCBased 35 0 R ] endobj 29 0 obj << /Length 799 /Filter /FlateDecode >> stream %- UT=z,hU="eDfQVX1JYyv9g> 8$>!7c`v{)cMuyq.y2 yG6T6 =Z]s:#uJ?,(:4@ E%cZ;R.q~&z}g=#,_K|ps~P{`G8z%?23{?