Firstly, in the activities that use the AppCompat ActionBar you need to import the necessary classes.
import android.support.v7.app.ActionBarActivity;
import android.support.v4.app.Fragment;
import android.support.v7.app.ActionBar;
//if you need to customize the ActionBar
Secondly, each *activity* must extend the ActionBarActivity class.
//say
public class MainActivity extends ActionBarActivity {
Thirdly, you need to declare the right theme in the styles.xml files in the various values/values-v11 folders.
<style name="AppBaseTheme" parent="Theme.AppCompat.Light">
<!--
Theme customizations available in newer API levels can go in
res/values-vXX/styles.xml, while customizations related to
backward-compatibility can go here.
-->
</style>
For *styles.xml* in **values-v14** folder :
<style name="AppBaseTheme" parent="Theme.AppCompat.Light.DarkActionBar">
<!-- API 14 theme customizations can go here. -->
</style>
If you have done things this way already, then I would like to add that the basic template created using the *New -> Other -> Android -> Android Application Project* option and setting the android:minSdkVersion="8" works well with Android 4.3 on the emulator and on devices. I have tested this and suggest you use this as a reference.