Mining Health Care Sequences using Weighted Associative Classifier

Table of contents

1. Introduction

ime plays a crucial role as patient's care as well as data collection and decision-making activities are performed over time. It is therefore often mandatory to deal with the temporal aspects by deriving useful summaries of the patient's behavior, including physiological signals or measurement time series, and adapting the decisions to the accumulated data and information. The goal of predictive data mining is to derive models that can use patient's historical information to exploit hidden information which will ultimately improve clinical Decision-making [1].

Diagnosis is related to the classification of patients into disease classes or subclasses on the basis of patients' data gathered from regular visit gathered time series. There are a growing number of papers that exploit data mining approaches for clinical prediction purposes. In a clinical context, predictions may support diagnostic, therapeutic, or monitoring tasks. Therapeutic prediction means the choice of the most suitable treatment for the patient.

Time series or temporal sequences; appear naturally in a variety of different domains, from engineering to scientific research, finance and medicine. In healthcare, temporal sequences are a reality for decades; with data originated by complex data acquisition systems like ECG's or even with simple ones like measuring the patient temperature or treatments effectiveness . In the last years, with the development of medical informatics, the amount of data has increased considerably, and more than ever, the need to react in real-time to any change in the patient behavior is crucial. In general, applications that deal with temporal sequences serve mainly to support diagnosis and to predict future behaviors [2].

The ultimate goal of temporal data mining is to discover hidden relations between sequences and subsequences of events. Just to mention few, following prediction can be performed using patient's historical temporal data. 1. Prediction for drug treatment planning or for the prognosis of surgical interventions. 2. Predictions in clinical monitoring are crucial in several contexts, such as in intensive care units (ICUs), which needs continue updating on the basis of the monitoring data. 3. Prediction may range from simply predicting the risk of disease based on the age factor or lifestyle for whole population, to the forecast of consequences of taking a particular drug or treatment for long time.

For example drug taken for hypertension for a long time may affect the functioning of kidney. 4. Prediction of chance of any disease or casualty on neonatal based on different symptoms and other information like weight, systematic growth mother's blood group etc. 5. Predicting the risk of chronic disease as a result of another disease. For example diabetic patient having hypertension are more prone to Cardio Vascular Disease.

In this paper we have proposed a general framework to mine prediction rule for the accurate treatment of disease which will ultimately lead to cure of disease. The framework uses the historical data of the patient consisting of sequence of treatment given at regular interval. Further each sequence element may be various pathological test or advanced test results, regular observations like blood sugar, blood pressure etc. and medicines and other treatment recommended to the patient for that time period. The database consists of set of sequence of treatment given to the patient and a class label that defines whether the patient is cured or not.

2. The major steps of the work proposed are

The proposed Framework for sequence mining is shown in figure1.

3. II.

4. Related Work a) Medical Prediction Using Temporal Data Mining

Temporal databases consist in databases containing time stamped information. A time stamp can be represented by a valid time, which denotes the time period in which the element information is true in the modeled real world, and/or by a transaction time, which is the time in which the information is stored in the database. Temporal data mining approaches provide the opportunity to address different tasks, such as data exploration, clustering, classification or prediction [3].

In [4] temporal data mining has been applied on the hepatitis temporal database collected at Chiba university hospital between 1982-2001. The database is large where each patient record consists of 983 tests represented as sequences of irregular timestamp points with different lengths. The work presents a temporal abstraction approach to mine knowledge from this hepatitis database.

In [5] visual data mining technique on temporal data is applied for the management of hemodialysis. The approach is based on the integration of 3D and 2D information visualization techniques which offers a set of interactive functionalities. The paper described the main features of IPBC (Interactive Parallel Bar Charts), a VDM system developed to interactively analyze collections of time-series, and showed its application to the real clinical context of hemodialysis.

In [6] temporal data mining techniques has been applied to extract information from temporal health records consisting of a time series of elderly diabetic patients' tests. The first step is to find pattern structures using structural-based search using wavelets. In the second step a value-based search over the discovered patterns using the statistical distribution of data values is performed. In the third step the results from the first two steps is combined to form a hybrid model. The feature of the hybrid model proposed is the expressive power of both wavelet analysis and the statistical distribution of the values. Global patterns have been identified successfully.

In [7] initially a framework is proposed for the definition of methods and tools for the assessment of the clinical performance of hemodialysis (HD) services, on the basis of the time series which has been automatically collected during hemodialysis sessions. For the implementation the method proposed is intelligent data analysis and temporal data mining techniques to gain insight and to discover knowledge on the causes of unsatisfactory clinical results.

In [8] a new kind of temporal association rule and the related extraction algorithm is proposed. An Apriori-like algorithm has been used to search for meaningful temporal relationships among the complex patterns of interest.

In [9] a new algorithm is presented to mining of Temporal Association Rules which has the main innovative feature of handling both events with a temporal duration and events represented by single time points. This new method has been applied to analyze the healthcare administrative data of diabetic patients. 1. Representation and modeling: In this step, sequences of the temporal data are transformed into a suitable form. Every unique sequence is assigned a numeric symbol using step 2 and ultimately the database is converted to form suitable to perform apriori type algorithm.

2. Similarity Measure: This step defines the similarity measures between sequences. We are using Euclidian distance measure to find the unique sequences.

3. Mining Operation: In this step actual mining operation is performed to extract hidden information. In this framework we are extracting the set of frequent sequences (representing the treatment given to the patient) applied on the patient, which ultimately caused the patient to be cured. Association rule mining is used to find the association among the treatment given, with the given class label, the rules in this step are known as Class Association Rule (CAR).

4. Prediction: We use the high confidence CAR rules generated in step 3 to predict the sequence of treatment.

The method is found to be useful to observe frequent health care temporal patterns in a population.

In [10] a general methodology for the mining of Temporal Association Rules on sequences of hybrid events is proposed. The experimental results show that the method can be a practically used for the evaluation of the care delivery flow for specific pathologies. In [11] the work done in [10] has been extended to focus on the care delivery flow of Diabetes Mellitus, and an algorithm is proposed for the extraction of temporal association rules on sequences of hybrid events. This work has been extended in [12] to show how the method can be used to highlight cases and conditions which lead to the highest pharmaceutical costs. Considering the perspective of a regional healthcare agency, this method could be properly exploited to assess the overall standards and quality of care, while lowering costs.

In [13] an efficient technique to match and retrieve the sequence of different lengths has been proposed. A number of the research works proposed earlier were concentrated on similarity matching and retrieval of sequences of the same length using Euclidean distance metric. In the matching process a mapping among non-matching elements is created to check for the unacceptable deviations among them. An indexing scheme is proposed for efficient retrieval of matching sequences, which is totally based on lengths and relative distances between sequences.

In [14] the analysis of sequential data streams to unearth any hidden regularities is discussed and also the applications of it in various field ranging from finance to manufacturing processes to bioinformatics is explained. The notions of sequential patterns or frequent episodes represent only the currently popular structures for patterns. The field of temporal data mining is relatively young hence new developments in the near future is yet to come. The paper discuss such several issues and others like what constitutes an interesting pattern in data, problem of defining data structures for interesting patterns, linking pattern discovery methods etc.

5. b) Association Rule Based Classifier

Given a set of cases with class labels as a training set, classification is to build a model (called classifier) to predict class label of future data objects. Associative classification is an integrated framework of association rule mining and classification. A special subset of association rules whose right-hand-side is restricted to the classification class attribute is used for classification. This subset of rules is referred as the class association rules (CAR). Extensive performance studies show that association based classification may have better accuracy in general [15], [16], [17]. The major advantages of new Predictive Model over the other models are- In section III we have discussed some basic definition for sequence mining. In section IV the different steps of sequence mining is discussed. In section V the algorithm weighted associative classifiers is discussed. In section VI conclusion and future work has been discussed.

6. III.

7. Problem Definition

Definition1: Sequence Database: A sequence database D is a set of records D[0], D[1],...,D[n]

where record D[i] represents the record of ith patient consists of ordered sequences, S(i,1), S(i,2), S(i,3), ?S(i,j),?, where each sequence S(i,,j) is observed at time stamp tj , 1? j ? n, n is positive integer. Si represents a sequence observed at time stamp ti. In database D the size of record may be varying because the number of visits for the complete treatment of one patient may be different from other patient.

Example: For patient 3 the number of sequence is i, whereas the number of sequence for patient 1, 2 and 4 is m. and their order in the sequence. The exact sequence length and structure of sequence will be based on the disease for which the training data is collected. A typical example of structure of sequence and sequence in case of heart patient may be-Example: Structure of the sequence is (Blood_ pressure_upper, Blood_pressure_lower, Fasting_Blood _Sugar, BMI, test1, test2, Medicine1, Medicine2, Medicine3) and corresponding sequence is (190,50, 150, result_test1, result_test2, med1, med2, med3).

1. Let Si is a sequence at ti and Sj is sequence at tj and S i , S j ? D[i] then S i =S j is possible. Let at time stamp ti , Si ? D[0] and Sj ? D [1] then Si?Sj or Si= Sj is possible. The operator = and ? are discussed in Definition 6.

2. Example: patient 2 and 4 have given same treatment at same time stamp, also patient 2 has been given same treatment from time stamp t 1 to t i .

Table 1 : Relational database D with set of temporal records IV.

8. Sequence Mining using Weighted

Association Rule a) Data Preparation Data preparation process includes preparation of the data of interest to be used for mining and convert this data to the format suitable to perform apriori type algorithm. The database of the form shown in Table I have to be converted into the form as shown in Table IV.

9. i. Discretisation/ Normalisation

In the database firstly we perform Discretisation/ Normalisation for the non temporal attributes like age, gender etc. Discretisation is the process of converting the range of possible values associated with a continuous data item (e.g. a double precision number) into a number of sub-ranges each identified by a unique integer label; and converting all the values associated with instances of this data item to the corresponding integer labels. For example for attribute age the subrange can be as shown in This is an important step in this framework. As once the database has been converted from database of sequences to the database of items, the apriori algorithm can be applied to find the association among the items, and ultimately the CAR rules can be generated for prediction.

To assign a unique numeric label to every unique sequences corresponding to each patient, sequence comparison method is required. There can be number of methods to compare the similarity of sequence.

Many time series representations and distance measure techniques have been proposed for more than one decade. Some of these approaches work well for short time series data, but they fail to produce satisfactory results for long sequences. There are two kinds of similarities: shape-based similarity and structure-based similarity. Shape based similarity is suitable for short sequences only. For the two sequences Si and Sj, shape-based determines the similarity based on local comparisons.

The well-known distance measure in data mining is Euclidean distance, in which sequences are aligned in the point-to-point fashion, i.e. the ith point in sequence Si is matched with the ith point in sequence Sj. Euclidean distance works well in many cases. Dynamic Time Warping (DTW) is another distance measure technique that overcomes the limitation by determining the best alignment to produce the optimal distance. Euclidean distance is a special case of DTW, where no warping is allowed, the dips and peaks in the sequences are miss-aligned and therefore not matched. In DTW, the dips and peaks of sequences are aligned and it provides more robust distance measure than Euclidean distance, compensation to that DTW a lot more computationally intensive as discussed in [13].

To determine the similarity for long sequence a more appropriate is to measure their similarity based on higher-level structures. Several methods for structure or model-based similarities have been proposed.

In this paper we use Euclidean distance measure for similarity search, For matching sequences we would like to address the following points.

? The relative times that the corresponding samples are collected are almost same in both sequences. This means that the lengths of sequences should be close to each other to be matched. ? The elements of both sequences are taken from the lifetime of the experiment in a rather uniformly manner. ? In numeric sequences from medical domains, since the elements are real numbers obtained from various pathological tests with a limited precision, elements from different sequences should be matched based on proximity. ? In non-numeric sequences, matching is done based on equality of their domain.

Definition 6: Sequence Similarity: Consider two sequences S 1 and S 2 having length x and y respectively, and e 1 ,e 2 ?.e x are matching q 1 , q 2 ,?..q y .

1. The sequences S1 and S2 matches each other ifi. Their length is same as ie length(S i )=length(S j )

ii. Distance (e k , q k )=0 ,for all values of k. Also the distance between two elements ek and qk can be defined as follows.

? For numeric elements, distance (e k , q k )= |e k -q k |. ? Non-numeric sequences can be matched based on equality. In that case, the distance between any two elements is defined to be distance(e k , q k ) = ? 0 , if dom(e k ) = dom(q k ) positive number, if dom(e k ) ? dom(q k ) 2. and S i ?S j if either condition i or ii is false.

10. c) Representation of Temporal Sequences

In order to perform the apriori like operation in the above dataset, we transform the original dataset consisting of sequences into the relational database consisting of numeric labels like 1, 2, 3?..etc, where each numeric label represents unique sequence. Sequences in one record are compared for their similarity and unique symbol is assigned to unique sequence.

In the database D consisting of m columns and n rows, we precede row wise from top to bottom and in each row we will precede from left to right. A unique numeric label num is assigned to the first sequence S(0,0) of first patient and maintains the processed sequence and num assigned to that sequence in arr as shown in Table V. Then we pick the next sequence S(I,j)and compare (using Euclidean distance) it with already processed sequences stored in arr. If the sequence matching is found then assign the same numeral to new sequence and no need to assign new numeric label. If the sequence is not present in the List arr then assign a num++ to the sequence and store the sequence and num to arr. Comparing the sequence in the list will always starts from first entry in arr but it will not be a time consuming process as there will be finite number of sequence in the original database D. This way entire database D is preprocessed to convert the database D' as shown in TableIV. The algorithm is discussed in figure 3. The weighted concept is used to improve the performance in terms of accuracy and number of rules generating as mentioned in [18]. In this paper the weighed concept have been utilized to assign more weights to the sequence (pathological test and medication to the patient at particular time period) having much impact on treatment of patient. Attribute is assigned weight based on the domain. For example item in supermarket can be assigned weight based on the profit on per unit sale of an item. In medical domain, symptoms can be assigned weight based on their significance on prediction capability. Maximumlikelihood estimation (MLE) is a method of estimating the parameters of a statistical model. By using iterative technique, the maximum likelihood estimator is measured upon varying probability values of items in the training dataset.

11. e) Frequent Sequence Mining

The problem of sequence mining has now been converted to frequent itemset mining in the database D' where items are nothing but sequence represented by numeric labels. Hence the following section contains terms and basic concepts to define sequence weight, sequencesetweight, recordweight, weighted support and weighted confidence for weighted associative classifiers.

The transformed training dataset D' consists of n distinct set of records i.e. D'= {r 1 , r 2 , r 3 ?. r n }. Where each record is collection of varying number of labels (representing temporal sequence) and value of class label. Each record has unique identifier called PID. Definition 7: Sequence weight It is same as Item weight in WARM [19]. In this work we have extended the definition for the sequences. Each sequence S i is assigned weight wi, denoted by w(S i ), where 0<w i <=1. Weight is used to illustrate the significance of the sequence. Attribute is assigned weight based on the domain. For example item in supermarket can be assigned weight based on the profit on per unit sale of an item. In medical domain, symptoms can be assigned weight based on their significance on prediction capability. Weight is calculated from training data using maximum likelihood estimation and denoted by wi. Table V shows the synthetic weight assigned to the sequences. Weighted Confidence: Weighted Confidence (WC) of a rule X?Y where Y represents the Class label and can be defined as the ratio of Weighted Support of (X?Y) and the Weighted Support of (X). (5,8,10,12)

W(X) = |X| ? W(S i ) i=1 Number of sequences in X |r k | ? W(S i ) i=1 m W(r k ) = |X| ? W(r i ) i=1 |n| ? W(r k ) k=1 WSP(X?Class_label ) = WC(X?Y) = WSP (X?Y) WSP (X) f) Classification Association Rule Generation

After generating all frequent item sets CAR rules are filtered using frequent item set having one of the class labels. Frequent item sets that does not contain any of the class label has to be removed. To generate significant CAR rules the weighted confidence threshold is used. Using WAC algorithm the set of CAR rules are generated as shown in figure 4. Finally the numeric labels are replaced by corresponding sequence using arr database and frequent sequences are generated as shown in figure 5.

12. Experiments and Results

We present the Temporal WAC results on real data collections of blood cancer disease.

13. a) Representation and Modeling

The data has been collected for 30 patient. The database consists of maximum 5 time stamp as shown in figure 7 Euclidian distance measure is used to convert the database consisting of above sequence to database consisting of numeric labels.

Total 26 unique sequences have been identified and 27, 28 are assigned as the numeric labels for "cure" and "not cure" class labels respectively.

14. c) Mining Operation

The WAC algorithm shown in figure 4 is used to mine the database and CAR rule are generated for the different support value. With the CAR rules the accuracy is calculated using same training data and the result is shown in Table 5. With the result shown in table 5 we conclude that accuracy is better in case of having CAR rules for all the class labels. The reason of less accuracy in case of single CAR rule may be the default class label we are

15. S. No

Note: Support

16. Conclusion and Future Work

This work presents a new foundational approach to mine frequent sequence using weighted associative classifiers whose core idea is to assign weights to the attributes depending upon their importance in predicting the class labels. The proposed model can be used as an alternative, computerized decision aid to assist physicians to find the sequence of treatment that can be given to the patient. The author feels confident in declaring that the framework is feasible one in the medical domain.

Figure 1. Fig 1 :
1Fig 1 : Sequence Mining framework using WAC.
Figure 2. Table II Table 2 :
II2
Time Dimension? t 1 ? t i ... t m
P_Id age gender S 1 ... S i ? S m class_label
1 45 f (190,50,150,result ... (200,90, 150, ? (200,90,150, Disease_
_test1, result_test1, result_test1, cured
result_test2, result_test2, med1, result_test2, med1,
med1) med2) med2
Patient Record? 2 3 30 55 f m (200,90,150, result_test1, result_test2, med1, med2) (190,50,150,result _test1, result_test2, ... ... (200,90, 150, result_test1, result_test2, med1, med2) (200,90, 150, result_test1, result_test2, med1, ? NA (190,50,150,result_test 1, result_test2, med1, med2) NA Disease_ Notcured Disease_ cured
med1) med2)
4 35 m (200,90,150, ... (200,90, 150, ? (190,50,150,result_test Disease_
result_test1, result_test1, 1, result_test2, med1, Notcured
result_test2, result_test2, med1, med2)
med1, med2) med2)
age categorical value
20-30 1
31-40 2
41-50 3
51-60 4
Normalisation is the process of converting
values associated with nominal data items so that they
correspond to unique integer labels. TableIII shows
normalization for attribute gender.
Figure 3. Table 3 :
3
We use DN (discretization/ normalisation)
software Version 2 available at site http://cgi.
Csc.liv.ac.uk/~frans/ KDD/ Software/ LUCS -KDD -
DN/exmpleDnnotes. html to perform Discreti sation/
Normalisation process.
b) Similarity Search for Sequences using Euclidean
Distance
Figure 4. Table 4 :
4
Figure 5. Table 5 :
5
Labels
Figure 6. Table 5 :
5
Definition 11 : A frequent sequence is a set of
sequences whose support is greater or equal than a
user-specified threshold called minimum weighted
support (WMin_sup). Given a dataset and WMin_sup,
the goal of sequence mining is to determine in the
dataset all the frequent sequences set whose support
are greater than or equal to WMin_sup.
Definition 12 :
Definition 8 : Sequence Set Weight: It is same as Itemset
weight in WARM[19]. In this work we have extended the
definition for the sequences set weight. Weight of
sequence set X is denoted by W(X) and is calculated as
the average of weights of enclosing attribute. And is
given by
Definition 9 : Record Weight: The tuple weight or record
weight can be defined as type of sequence set weight. It
is average weight of sequences in the patient record. If
the transactional table is having m number of sequence
then Record Weight is denoted by W(rk) and given by
Definition 10 : Weighted Support: In associative
classification rule mining, the classification association
rules R: X?Y is special case of association rule where Y
is the class label. Weighted support (WSP) of rule
X?Class_label, where X is non empty set of sequences,
is fraction of weight of the record that contain above
sequence set relative to the weight of all transactions.
This can be given as
Here m is the total number of records.
Example: Let sequence Si= (190,50, 150,result_test1,
result_test2, med1) and
Sj= (200,90, 150, result_test1, result_test2, med1,med2)
Consider a rule R: (( Si, Sj) ? Class_label) then
Weighted Support of R is calculated as:
Figure 7. Table 6 :
6
P_Id Age Gender Time_slot1 Time_slot2 Time_slot3 Time_slot4 Time_slot5 Class_Label
Note: i
1
2

Appendix A

Appendix A.1

Proceedings of IDAMAP 2008 Workshop, Washington, 75-80, http://labmedinfo.org/down load/lmi503.pdf. The purpose of this experiment is to show that Framework shown in figure1 is possible to implement and can generate useful result in medical domain can be used for the purpose stated in introduction section. The authors are confident enough that improved result assigning during accuracy calculations. The Efficient CAR rules can be generated using enough training record.

Appendix B

  1. Bao Tu , Trong Dung Ho , Saori Nguyen , Si Quang Kawasaki , Dung Duc Le , Hideto Nguyen , Katsuhiko Yokoi , Takabayashi . Mining Hepatitis Data with Temporal Abstraction,
  2. Integrating classification and association rule mining. B Liu , W Hsu , Y Ma . KDD'98, (New York, NY
    ) Aug.1998.
  3. Mining Administrative and Clinical Diabetes Data with Temporal Association Rules. Concaro Stefano , Sacchi Lucia , Cerra Carlo , Bellazzi Riccardo . Medical Informatics in a United and Healthy Europe, 2009. IOS Press. p. .
  4. Weighted Association Rule Mining using Weighted Support and Significance Framework. Feng Tao , Fionn Murtagh , Mohsen Farid . proceedings of the ninth ACM SIGKDD International conference on Knowledge Discovery and Data Mining, (the ninth ACM SIGKDD International conference on Knowledge Discovery and Data Mining) 2003. p. .
  5. Data mining with temporal abstractions: Learning rules from time series. L Sacchi , C Larizza , C Combi , R Bellazzi . Data Mining Knowledge Discovery 2007. 15 p. .
  6. Data Mining on Temporal Data:a Visual Approach and its Clinical Application to Hemodialysis. Luca Chittaro , Carlo Combi , Giampaolo Trapasso . Journal of Visual Languages and Computing December 2003. 14 (6) p. .
  7. Matching and Indexing Sequences of Different Lengths, Tolga Bozkaya Nasser Yazdani Meral ¨Ozsoyo?glu,
  8. Temporal Data Mining: an overview. M Cláudia , Arlindo L Antunes , Oliveira . Lecture Notes in Computer Science pp p. .
  9. Temporal data mining for the quality assessment of hemodialysis services. R Bellazzi , C Larizza , P Magni , R Bellazzi . Artificial Intelligence in Medicine 2005. 34 p. .
  10. Predictive data mining in clinical medicine: a focus on selected methods and applications, Riccardo Bellazzi , Fulvia Ferrazzi , Lucia Sacchi . 2011. y 2011. John Willey & Sons , Inc. 00.
  11. , Srivatsan Laxman , P Sastry A . survey of temporal data mining April 2006. 31 p. .
  12. Stefano concaro, temporal emporal data mining for the analysis of healthcare data, 2006-2009. (ph.d. Thesis)
  13. Temporal Data Mining for the Assessment of the Costs Related to Diabetes Mellitus Pharmacological Treatment. Stefano Concaro , Lucia Ms , Carlo Sacchi , Mario Cerra , Stefanelli . AMIA 2009 Symposium Proceedings Page, p. .
  14. Mining Healthcare Data with Temporal Association Rules: Improvements and Assessment for a Practical Use. Stefano Concaro , Lucia Sacchi , Carlo Cerra , Pietro Fratino , Riccardo Bellazzi . LNAI 2009. 2009. Springer-Verlag. 5651 p. .
  15. Performance Evaluation of Weighted Associative Classifier in Health Care Data Mining and Building Fuzzy Weighted Associative. Sunita Soni , O P Vyas . PDCTA 2011, CCIS 203, D Classifier, E Nagamalai, M Renault, Dhanushkodi (ed.) (Berlin Heidelberg
    ) 2011. 2011. Springer-Verlag. p. .
  16. Mining Temporal Patterns from Health Care Data, Weiqiang Lin , A Mehmet , Graham J Orgun , Williams .
  17. CMAR: Accurate and efficient classification based on multiple classassociation rules. W Li , J Han , J Pei . ICDM'01, (San Jose, CA
    ) Nov.2001. p. .
  18. CPAR: Classification based on predictive association rule. X Yin , J Han . Proceedings of the SIAM International Conference on Data Mining, (the SIAM International Conference on Data MiningSan Francisco, CA
    ) 2003. SIAM Press. p. .
Notes
1
© 2014 Global Journals Inc. (US)
2
© 2014 Global Journals Inc. (US)Mining Health Care Sequences using Weighted Associative Classifier
Date: 2014-01-15