Developing Humanoid Robot Animations in Motion Capture

growing Humanoid Robot Animations in doubt CaptureIntroduction (Chapter 1)This research describes the frame give way in which the antithetic benignant being movements fill been interpreted from interrogative sentence hitch and that instruction is animated which discip suck ups the direction to take on the digital character models and its change of location in the virtual(prenominal)(prenominal) milieu. It alike gives feasible get on in understanding of paseo gait patterns in that environment. This framework also leads to the conduct issues related to safety engineering.OverviewAnalysis of human loco interrogative sentence and its research atomic number 18a have changed since it began form the cave drawings of the Paleolithic Era. The motive for human locomotion studies at early stages were driven by the need to strain on by resourcefully moving from describe to place, dodging from predators and hunting for food (Alexander, 2000). Modern-day human locomotion studi es have added to a wide dress of applications ranging from military consumption, sport, ergonomics, and health cargon. In locomotion studies, according to (H in all, 1991) the term biomechanicsbecame accepted during the early 1970s as the internationally recognized descriptor of the subject field of area concerned with the mechanical area of living organism. In sport, human locomotion studies are made to extend the restrictions of an athlete when even the minimum onward motion in performance is pursued eagerly (J. A. , 1984). However, the development of human locomotion studies remains reliant on the improvement of new tools for observation. According to (Alexander, 2000) lately, instrumentation and entropy do bying arrangement technology have grant opportunities for the improvement of the show of human locomotion. (J. A. , 1984).Illustrate frequent proficiencys for measurement motion and intimateed the co-ordinate analyzer (motion acquire imposture) as a major(ip) ad vance in movement study. According to (Furniss, 2000) exertion capture or mocap was initially created for military use earlier than it was modified into the entertainment industry since the mid 1980.s. (Dyer, 1995) define motion capture as measuring an objects location and direction in physical space, then recording that sequence into a computer useable form. According to(Micheal, 2003) (Suddha Basu, 2005) motion capture is the fastest way to produce rich, realistic elan vital info. (James F OBrien, 2000) expand that Mocap raise also be effectual in several(prenominal) additional palm such as music, fine art dance, sign language, motion recognition, rehabilitation with medicine, biomechanics, special effects for become-action films and computer animation of all types as hearty as in defense and athletic abstract/training. at that place are fundamentally troika types of motion capture systems accessible such as mechanical, electro magnetised and optical establish system . alone three systems go through the analogous basic process shown in figure. The inaugural step is the gossip where the movement of live musicians all human or animal is recorded using discordant rule depending on the type of the motion capture system use. Next, the information is processed to identify the corresponding markers of the live actor and then transferred into virtual space using specialized computer software system. Finally the rig is where the information is translated into a 3D trajectory computer info that contains translation and rotation information known as motion capture file.MotivationProducing realistic character animation remains one of the great challenges in computer graphics. At present, there are three method actings by which this animation heap be produced. The first one is key framing, in which the animator gives important key wash ups for the character at ad hoc frames. A bite one uses physical simulation to drive the characters motion i ts results are good, repayable to oerlook of jibe its demanding to use and its costly and with characters its non much successful. The last one is motion capture, has been widely use to animate characters. It uses sensors placed on person and collects the data that describes their motion however they are performing the coveted motion. As the technology for motion capture has improved and the cost decreased, the interest in using this set out for character animation has also increased. The main challenge that an animator is confronted with is to generate character animation with a realistic appearance. As humanoid robot renovation is a usual research area since it scum bag be used in various applications to understand the emerging field of robotics and different digital animation fields. Currently most of the methods work for controlled environments and human pose reconstruction to recognize humanoid robots is a popular research area since it kitty be used in various appli cations. Motion capture and motion synthesis are overpriced and time consuming tasks for articulated figures, such as humans. Human pose view based on computer vision principles is inexpensive and widely applicable approach. In computer vision literature the term human motion capture is usually used in federation with large scale be analysis ignoring the fingers, hands and the facial muscles, which is the case in this research. The motion capture is fairly involved to calculate a 3D skeletal representation of the motion of satisfactory esteem to be functional for animation. The animation generation is an application of motion capture where the indispensable the true is not as high as in some(prenominal) other applications, such as medicine (Ferrier, June 2002) puzzle Context1) Even though motion capture is applied into so some(prenominal) fields by creating physically perfect motions, it has a few significant weaknesses. According to (Lee, MCML Mocap, 2004) firstly, it has l ow flexibility, secondly the captured data can have disparate data formats depending on the motion capture system which was employed and thirdly, commercially obtainable motion capture libraries are elusive to use as they a great deal include hundreds of examples. (Shih-Pin Chao, 2003) States that motion capture sessions are not only costly scarcely also a labor intensive process thus, promotes the usability of the motion data.2) In the field of animation and gaming industry, it is common that motion information are captured to be used for a go againsticular project or stored in a mocapdata. This data can each be used as the whole range of motion sequence or as part of a motion synthesis. In sport science, mocap data is used for analyzing and perfecting the sequencing mechanics of premier athletes, as well as monitoring the recovery progress of physical therapies. This simply doer that a vast entreaty of motion capture data models are limited for dissimilar sets. Currently , motion data are much stored in slender clips to allow for easy hand sequencing for describing the behavior (Jernej Barbic, 2004) (Tanco L. M., 2000). However, according to (Lee, MCML Mocap, 2004) (Morales, 2001) (Tanco L. M., 2000) a motion capturedata models lack interoperability. This calls for an immediate need for tools that synchronize these datasets (Feng Liu, 2003).3) In light of the recent course of interest in virtual environment applications, much research has been devoted to solving the problems of manipulating humans in 3-D simulated worlds, and in particular to human locomotion. However, most of the animation approaches based on these studies can only generate limited approach lacking the locomotion capabilities for example walking their application in virtual environments are inevitably limited. end ObjectiveThe objective of this project is to create a framework taken from motion capture data techniques which can set the direction to study 3D articulated figures a nd the humanoid robot locomotion in the virtual environment by understanding walking gait patterns in human. This framework also leads to the study issues related to safety engineering.The other objective of this project is to capture, process, and examine the locomotion feasibility in virtual environment and analyze different tasks in virtual environment.In system overview diagram all the different steps has been described it starts from mocaop suit that is on the subject and then its data of random movement has been taken into computer and motion analysis is done. After motion analysis its been retargeted and with avatar model the final output scenery has been created. Then with software development kit feasible program has been created to deal with different information of that scene.Project ScopeTo capture the human motion from the motion capture technology and using the captured data to animate the different motions and then refining the animated data. By using the technology called motion detergent builder we can simulate and study the effects of walk and fall in the virtual environment. After routine the captured data in the animated character which is called digital humanoid robot an application is build to study the nature of the animated scene which is called an enhanced framework. The other technology is used is called mathematica which is used for studying the factors in mathematical terms because the human motion builder is a simulation technology and mathematica is a moral force solver engine. So it will lead towards the study of digital humanoid robot of walking and falling in virtual environments on some assumptions.OutlineThis part outlines the in public building of the thesis, and a short explanation for each chapterChapter 1 deals with Introduction, celestial orbit and objective with problem context.Chapter 2 Introduces human motion capture techniques and different work in animation of human walking in virtual environment and gives a s ummary of the related work in this area.Chapter 3 deals with the system twist which describes the hardware and the software technologies involved in the research and also illustrate the frame work model and this model patron exploit the behavior of humanoid which sets up the framework.Chapter 4 describes the framework analysis based on the study of articulated animation models in virtual environment and walking gait patters with Bezier lift algorithm.Chapter 5 mention all the techniques that have been extracted from different softwares and how its used to set up the whole framework and evaluates results which are categorize in three phases the application which represents coordinate system and structure, walking gait patters by using Bezier curve and the falling effect by visual aid.Chapter 6 is the conclusion that summarizes the outcome of the project, and discusses the future works.ConclusionThis chapter describes the groundwork of motion capture and how it will be utilized t o improve the study of human locomotion. The project scope and objectives are elaborated and listed down in this chapter.Literature Review (Chapter 2)Motion capture systemMotion capture is an attractive way of creating the motion parameters for computer animation. It can turn in the realistic motion parameters. It permits an actor and a director to work together to create a desired pose, that may be difficult to describe with enough specificity to have an animator recreate manually (Ferrier, June 2002). The application areas of motion capture techniques can be summarized as follows (Perales, 2001)Virtual reality interactive virtual environments, games, virtual studios, character animation, film, advertising languish surveillance systems access control, parking lots, supermarkets, vending machines, traffic.Advanced substance abuser interfaces advanced user interfaces.Motion analysis and synthesis annotations of videos, personalized training, clinical studies of medicine.Understandi ng the working of humanoid robot has been always on study of human locomotion. This literature review discusses human motion control techniques, motion capture techniques in general and advance, non-vision based motion capture techniques, vision-based motion capture techniques with and without markers and other enhanced techniques which are covered in details for which the framework can be understood easily.Properties of trailing SystemsThis section lists properties of skiping systems and discusses the relationships among the various properties.AccuracyAccuracy can be defined as the agreement mingled with the measured results from track technologies and the actual blank space of the object, and because the true value is unknown the trailing technologies can only be evaluated with sexual congress truth. For one introduce system, the accuracy is limited by the principle and affected by the noise/ term of enlistments from the environment. The sources of noises are depending o n the tracking technology we use. For different tracking principles, the influencing factors are different. For example, for optical motion tracking, the hinderance is ignition and AC current for magnetized, ferrous objects distort the magnetized field and cause errors. If the model or the mechanics of the noise is quantitatively known, it is a systematic error and can be compensated by post-treatment later on tracking or eliminated by pre-filtering before tracking.RobustnessRobustness defines the systems ability to continue to function in adverse conditions or with missing or incorrect measurements. both(prenominal) systems make assumptions about the surrounding environment during operation. Also, a system may be unable to take a measurement at a particular time. Related to the robustness is repeatability in the reported data. If the reported values are consistent over time and over operating conditions and environment, then measuring the accuracy (or the lack thereof) is pos sible, and corrective algorithms can be applied.Tracking rangeThe range is the space in which the system can measure sufficient and spotless data for the application. For some systems, the range can be reduced by noises from the environment or be limited by the hardware of the system itself. For example, magnetic system cannot track accurate data when the introduce object is at the margin of the magnetic field due to the inhomogeneous distri only whenion of the field.Tracking recreateTracking step on it is the frequency at which the measurement system can obtain the updated tracking data. in that compliancy are both significant numbers for the system, one is update rate and the other one is latency. modify rate is the frequency at which the tracking system gene order the tracking data latency describes the delay between tracking data has been generated and the host computer receives the data in real-time mode.HardwareThe hardware means the physical realization of the compone nts of the tracking system. It includes the number of components, and the size of it and weight of those components, especially those that the user is required to widen (or wear). round systems may have a significant amount of hardware that mustiness be set up in the environment, although it may need no further attention from the user once in position. Ideally, the application would like to give the user off freedom of movement. Some devices tether the user to a unconquerable object. Some systems may have a heavy or unwieldy device which the user must manipulate in order to move. Some devices have a proclivity to pull the user back to a resting position for the device. The hardware also congeals the biggest part of the costs and therefore is very often a decisive factor for the choice of the applied motion tracking systemNon-vision Based Motion CaptureIn non-vision based systems, sensors are connected to the human personate to collect movement information. Some of them hav e a small sensing footprint that they can detect small changes such as finger or toe movement (Hu, A heap human movement tracking and shooting rehabilitation, 1996). Each kind of sensor has advantages and limitations (Hu, A survey human movement tracking and stroke rehabilitation, 1997).Advantages of magnetic trackersreal-time data output can provide immediate feedbackno post processing is requiredthey are less expensive than optical systemsno occlusion problem is observed quaternate performers are possibleDisadvantages of magnetic trackersthe trackers are sensitivity to alloy objectscables restricts the performersthey provide lower sampling rate than some optical systemsthe marker configurations are difficult to changeAdvantages of electromechanical body suitsthey are less expensive than optical and magnetic systemsreal-time data is possibleno occlusion problem is observedmultiple performers are possibleDisadvantages of electromechanical body suitsthey provide lower sampling r atethey are difficult to use due to the amount of hardwareconfiguration of sensors is fixedVision-Based Motion Capture with MarkersIn 1973, Johansson explored his illustrious Moving Light Display (MLD) psychological experiment to perceive biological motion (Johansson). In the experiment, small reflective markers are attached to the joints of the human performers. When the patterns of the movements are observed, the integration of the signals coming from the markers resulted in recognition of actions. Although the method faces the challenges such as errors, non-robustness and expensive computation due to environmental constraints, mutual occlusion and complicated processing, many marker based tracking systems are available in the market. This is a technique that uses optical sensors, e.g. cameras, to track human movements, which are captured by placing markers upon the human body. Human skeleton is a highly articulated structure and moves in three-dimension. For this reason, each bo dy part continuously moves in and out of occlusion from the view of the cameras, resulting in inconsistent and unreliable motion data of the human body. One major drawback of using optical sensors and markers, they cannot sentience joint rotation accurately. This is a major drawback in representing a real 3D model (Hu, A survey human movement tracking and stroke rehabilitation, 1997). Optical systems have advantages and limitations (Perales, 2001).Advantages of optical systems are as followsthey are more accuratelarger number of markers are possibleno cables restricts the performersthey produces more samples per secondDisadvantages of optical systemsthey require post-processingthey are expensive (between 100, 000 and 250, 000)occlusion is a problem in these systemsenvironment of the capturing must be away from yellow light and reflective noiseVision-Based Motion Capture without MarkersAs a less restrictive motion capture technique, markerless-based systems are capable of overcomi ng the mutual occlusion problem as they are only concerned about boundaries or features on human bodies. This is an active and promising but also challenging research area in the last decade. The research with respect to this area is slake ongoing (Hu, A survey human movement tracking and stroke rehabilitation, 1996). The markerless-based motion capture technique exploits immaterial sensors like cameras to track the movement of the human body. A camera can be of a resolution of a million pixels. This is one of the main reasons that optical sensors attracted peoples attention. However, such vision-based techniques require intensive computational power (Bryson, 1993). As a commonly used framework, 2D motion tracking only concerns the human movement in an image plane, although sometimes people intend to project a 3D structure into its image plane for processing purposes. This approach can be catalogued with and without explicit shape models (Hu, A survey human movement tracking and stroke rehabilitation, 1996). The creation of motion capture data from a iodine video stream seems like a plausible idea. People are able to watch a video and understand the motion, but clearly, the computing the human motion parameters from a video stream are a challenging task (Ferrier, June 2002). Vision-based motion capture techniques usually include initialization and tracking steps. initializationA system starts its operation with correct interpretation of the current scene. The initialization requires camera calibration, adaptation to scene characteristics and model initialization. Camera calibration is defined as parameters that are required for translating a full point in a 3D scene to its position in the image. Some systems find initial pose and development it from frame to frame whereas in other systems the user specifies the pose in every single frame. Some systems have special initialization phase where the start pose is found automatically whereas in others the re sembling algorithm is used both for initialization and pose estimation (Granum, 2001).TrackingTracking phase extracts specific information, either low level, such as edges, or high level, such as head and hands. Tracking consists of three parts (Granum, 2001)Figure-ground segmentation the human figure is extracted from the rest of the image.Representation segmented images are reborn to another presentation to reduce the amount of information.Tracking over time how the subject should be bring in from frame to frame.MechanicalMechanical measurement is the oldest form of location rulers and tape measures provide a wide method of locating one item with reference to another. More sophisticated mechanical techniques have been developed. present measurements of the angles of the body joints with potentiometers or shaft encoders combined with knowledge of the dimensions of the rigid components allow accurate calculations of the position of different body parts.(Beresford, 2005)Today mech anical position tracking devices can be separated into body-based and ground-based systems.Body based systems are those which are mounted on, or carried on, the body of the user and are used to comprehend either the relative positions of various parts of the users body or the position of an instrument relative to a fixed point on the users body. Body-based systems are typically used to determine either the users joint angles for reproduction of their body in the synthetic environment, or to determine the position of the users hand or foot, relative to some point on the users body. Since the body based systems are used to determine the relative position between two of the users body parts, the devices must somehow be attached to the users body. This particular issue has raised many questions How is the device attached to the body in a way which will minimize relative motion between the attachment and the soft body part? How are the joints of the device aligned with the users joints to minimize the difference in the centers of rotation? Some other problems associated with body-based tracking systems are specifically caused by the device being attached to the users body. These systems are typically very obtrusive and encumbering and therefore do not allow the user complete freedom of movement. Body-based systems are, however, quite accurate and do not experience problems like measurement drift (the tendency of the devices output to change over time with no change in the sensed quantity), interference from external electromagnetic signals or metallic devices in the vicinity, or shadowing (loss of sight of the bring in object due to physical interference of another object)(Frey, 1996).Ground based systems are not carried by the user but are mounted on some fixed surface (i.e. the users desk or the floor) and are used to sense the position of an implement relative to that fixed surface. Ground-based systems are typically used to determine the position and predilec tion of an implement manipulated by the user relative to some fixed point which is not on the users body. bid body-based mechanical systems, they are very accurate and are not plagued by measurement drift errors, interference or shadowing. Ground-based systems do suffer from one thing which the body-based systems do not They confine the user to work within the space allowed by the device. Usually this means that the user is confined to work in a space the size of a large desk. If the application does not require the user to move somewhat much throughout the task (i.e. the user remains seated), this is not considered as a problem.Mechanical tracking systems are the best choice for force-feedback (haptic) devices since they are rigidly mounted to either the user or a fixed object. Haptic devices are used to allow the user a sense of touch. The user can feel surfaces in the synthetic environment or feel the weight of an object. The device can take forces to the users body so that th e user can experience a sense of exertion. Mechanical tracking systems also typically have low latencies (the time required to receive useful information about a sensed quantity) and high update rates (the rate at which the system can provide useful information). Therefore these systems have found good commercial niche as measurement devices and hand tracking systems.Advantageshigh update ratelow latencyaccurateNo blocking problem, no interference from environment best choice for force feedbackDisadvantagesRestricted movement from mounted device acousticAcoustic tracking systems utilize high frequency sound waves to track objects by either the triangulation of several telephone receivers (time-of-flight method) or by measuring the signals phase difference between vector and receiver (phase-coherence method).Generally the user carries the sender, and a series of sensors around the room determine the linear distance to the transmitter. Some systems have the user carry a receiver an d listen to a series of transmitters positioned around the volume.The time-of-flight method of acoustic tracking uses the speed of sound through air to calculate the distance between the transmitter of an acoustic pulse and the receiver of that pulse. The use of one transmitter on a tracked object and a minimum of three receivers at stationary positions in the vicinity allow an acoustic system to determine the relative position of the object via triangulation. This method limits the number of objects tracked by the system to one. An alternative method has been devised in which several transmitters are mounted at stationary positions in the room and each object being tracked is fitted with a receiver. Using this method, the positions of numerous objects may be determined simultaneously. Note that the use of one transmitter (or one receiver) attached to an object can resolve only position. The use of two transmitter (receiver) sets with the same object can be used to determine the pos ition and orientation (6 DOF) of the object. The desire to track more than just the position of an object suggests that the second method (multiple stationary transmitters with body mounted receivers) may be preferable.The other method of acoustic tracking is the phase-coherent tracking. It may be used to achieve better accuracies than the time-of-flight method. The system does this by sensing the signal phase difference between the signal sent by the transmitter and that detected by the receiver. If the object being tracked moves farther than one-half of the signal wavelength in any direction during the period of one update, errors will result in the position determination. Since phase coherent tracking is an incremental form of position determination, small errors in position determination will result in larger errors over time (drift errors), which may be the reason why only few phase-coherent systems have been implemented successfully.Some problems associated with both acoustic tracking methods result from the line-of-sight required between transmitter and receiver. This line of sight requirement obviously plagues the devices with shadowing problems. It also limits their effective tracking range, although they have better tracking ranges than electromagnetic systems. Unlike electromagnetic systems, they do not suffer from metallic interference, but they are sensitised to interference caused by ambient noise sources, by reflections of the acoustic signals from hard surfaces, and environmental interference (e.g. temperature variations).Advantages truly high freedom of movementCheapDisadvantagesLine-of-sight problemsEither high range or high accuracy (not both)Environmental interference (e.g. temperature variations, other noise sources)Drift errors (phase-coherent)High latency, low update ratesMagneticElectromagnetic tracking systems are currently the most widely used systems for human body tracking applications. They employ the use of artificially-generated electromagnetic fields to induce voltages in detectors attached to the tracked object. A fixed transmitter and the sensors consist of three coils mounted in mutually orthogonal directions. The sensors range in size, but tend to be around a few cubic centimeters. The transmitters range in size with the power of the field they are expected to generate, and range from several cubic inches to a cubic foot. There are four magnetic fields that have to be measured the environmental field (including the Earths magnetic field), and three orthogonal fields in the transmitters coordinate directions in figure. Each of these fields is measured in the sensors three coordinate dimensions for a total of twelve measurements of each sensor. From this information, the position and orientation of the sensor with respect to the transmitter can be computed.These tracking systems are robust, fast, and fairly inexpensive and can be used to track numerous objects (body parts) with acceptable position and o rientation accuracies (on the order of 0.1 inches and 0.5 degrees). Unlike electric fields, magnetic fields are unaffected by the presence or absence of human bodies and other non-metallic objects in the environment. This offers a tremendous opportunity, because it enables magnetic trackers to overcome the line-of-sight requirement that plagues acoustic, optical, and externally connected mechanical tracking systems. On the other hand, the magnetic systems suffer from sensitivity to background magnetic fields and interference caused by ferrous metal devices in the vicinity, and therefore is inaccurate in practical environments. Due to this and the limited range of the generated magnetic field, the magnetic tracking systems are restricted to a small special area.AdvantagesHigh update rates very low latencyHigh robustnessNo shadowingRather cheapAcceptable accuracy in artificial environmentDisadvantagesHigh sensitivity to background magnetic fieldsInaccurate in practical environments du e to interference caused by ferrous metal devicesLow range of the magnetic field and Tracking scope is low due to cableInertialAn internal sensor contains three gyroscopes, to determine the angular rate, and three accelerometers, to determine linear acceleration. Originally, they were mounted to orthogonal axes on a gimbaled platform, as it can be seen in figure. After removing the effect of gravity from the vertical accelerometer, the data has to be double-integrated to provide a measure of the offset between initialization and the current position. In fact, this combination of sensors has been used successfully for inertial navigatio